[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:32:53 dist-test-slave-gcz9 krb5kdc[6299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:32:53 dist-test-slave-gcz9 krb5kdc[6299](info): set up 2 sockets
Sep 24 17:32:53 dist-test-slave-gcz9 krb5kdc[6299](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260924 17:32:54.915269 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:32:54 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:32:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:32:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:32:55.037532 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38155
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:38155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:55.131846 6312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:55.132097 6312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:55.132139 6312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:55.133322 6312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:32:55.133390 6312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:55.133419 6312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:55.133451 6312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:32:55.133486 6312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:32:55.135262 6312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:38155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:55.135711 6312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:55.136018 6312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:55.143703 6317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.143891 6320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.144168 6318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:55.144320 6312 server_base.cc:1034] running on GCE node
I20260924 17:32:55.144644 6312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:55.145108 6312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:55.146299 6312 hybrid_clock.cc:648] HybridClock initialized: now 1790271175146289 us; error 82 us; skew 500 ppm
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:55.149240 6312 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:32:55.149976 6312 webserver.cc:460] Webserver started at http://127.6.37.62:45021/ using document root <none> and password file <none>
I20260924 17:32:55.150345 6312 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:55.150424 6312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:55.150600 6312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:55.152065 6312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "992c19adc2ae485c83ab07b6995667d2"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "86941936e03c13d134882a8139c9f2ac"
server_key_iv: "d9c7ffc71bcd5db415290acba96db447"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.152761 6312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "992c19adc2ae485c83ab07b6995667d2"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "86941936e03c13d134882a8139c9f2ac"
server_key_iv: "d9c7ffc71bcd5db415290acba96db447"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.154968 6312 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260924 17:32:55.156244 6327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.156595 6312 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:32:55.156734 6312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "992c19adc2ae485c83ab07b6995667d2"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "86941936e03c13d134882a8139c9f2ac"
server_key_iv: "d9c7ffc71bcd5db415290acba96db447"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.156855 6312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:55.169121 6312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:55.171623 6312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:55.171823 6312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:55.176622 6312 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:38155
I20260924 17:32:55.176698 6379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:38155 every 8 connection(s)
I20260924 17:32:55.177276 6312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:32:55.178715 6380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:55.182030 6380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2: Bootstrap starting.
I20260924 17:32:55.183197 6380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:55.183640 6380 log.cc:824] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:55.183759 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 6312
I20260924 17:32:55.183894 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:32:55.184686 6380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2: No bootstrap required, opened a new log
I20260924 17:32:55.184870 6292 external_mini_cluster.cc:1428] Setting key acbe331cca1639fb1ea200ab13e3d886
I20260924 17:32:55.187738 6380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992c19adc2ae485c83ab07b6995667d2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38155 } }
I20260924 17:32:55.187994 6380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:55.188094 6380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 992c19adc2ae485c83ab07b6995667d2, State: Initialized, Role: FOLLOWER
I20260924 17:32:55.188309 6380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992c19adc2ae485c83ab07b6995667d2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38155 } }
I20260924 17:32:55.188503 6380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:32:55.188603 6380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:32:55.188680 6380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:32:55.190117 6380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992c19adc2ae485c83ab07b6995667d2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38155 } }
I20260924 17:32:55.190353 6380 leader_election.cc:302] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 992c19adc2ae485c83ab07b6995667d2; no voters:
I20260924 17:32:55.190658 6380 leader_election.cc:288] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:32:55.190675 6385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:32:55.190907 6385 raft_consensus.cc:686] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [term 1 LEADER]: Becoming Leader. State: Replica: 992c19adc2ae485c83ab07b6995667d2, State: Running, Role: LEADER
I20260924 17:32:55.191066 6385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992c19adc2ae485c83ab07b6995667d2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38155 } }
I20260924 17:32:55.191114 6380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:32:55.191628 6386 sys_catalog.cc:455] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "992c19adc2ae485c83ab07b6995667d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992c19adc2ae485c83ab07b6995667d2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38155 } } }
I20260924 17:32:55.191653 6387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 992c19adc2ae485c83ab07b6995667d2. Latest consensus state: current_term: 1 leader_uuid: "992c19adc2ae485c83ab07b6995667d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "992c19adc2ae485c83ab07b6995667d2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38155 } } }
I20260924 17:32:55.191790 6386 sys_catalog.cc:458] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [sys.catalog]: This master's current role is: LEADER
I20260924 17:32:55.191805 6387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2 [sys.catalog]: This master's current role is: LEADER
I20260924 17:32:55.192934 6391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:32:55.194440 6391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:32:55.196866 6391 catalog_manager.cc:1347] Generated new cluster ID: 5d116d22840c476d822ba9a20a5d450c
I20260924 17:32:55.196920 6391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271174, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:55.208590 6384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.186283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42008 (local address 127.6.37.62:38155)
0924 17:32:55.189144 (+ 2861us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:55.189153 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:55.189185 (+ 32us) server_negotiation.cc:407] Connection header received
0924 17:32:55.189822 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:55.189828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:55.189898 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:55.190014 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:55.193006 (+ 2992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.195440 (+ 2434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.197314 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.197983 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.198143 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.203382 (+ 5239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:55.203387 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:55.203387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:55.203401 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:55.206082 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.206606 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.206610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.206610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.206760 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.207160 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.207161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.207162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.207547 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:55.207739 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:55.208060 (+ 321us) server_negotiation.cc:299] Negotiation successful
0924 17:32:55.208241 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":130,"threads_started":1}
I20260924 17:32:55.215322 6391 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:32:55.216213 6391 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:32:55.224881 6391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 992c19adc2ae485c83ab07b6995667d2: Generated new TSK 0
I20260924 17:32:55.225075 6391 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:32:55.264873 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38155
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:55.364902 6406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:55.365101 6406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:55.365134 6406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:55.366477 6406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:55.366521 6406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:55.366549 6406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:32:55.368040 6406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38155
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:55.368323 6406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:55.368557 6406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:55.374748 6414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.374785 6411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.374773 6412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:55.375273 6406 server_base.cc:1034] running on GCE node
I20260924 17:32:55.375507 6406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:55.375737 6406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:55.376904 6406 hybrid_clock.cc:648] HybridClock initialized: now 1790271175376884 us; error 31 us; skew 500 ppm
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:55.379789 6406 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:32:55.380229 6406 webserver.cc:460] Webserver started at http://127.6.37.1:42427/ using document root <none> and password file <none>
I20260924 17:32:55.380435 6406 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:55.380475 6406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:55.380563 6406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:55.381613 6406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "923be84939a24ef6a3ecb13a3f78180e"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "5229d661487e3b3162952b9158247184"
server_key_iv: "1ac40f753ddaa7fefaec61f6398bf93a"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.381984 6406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "923be84939a24ef6a3ecb13a3f78180e"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "5229d661487e3b3162952b9158247184"
server_key_iv: "1ac40f753ddaa7fefaec61f6398bf93a"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.383536 6406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260924 17:32:55.384269 6421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.384445 6406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:32:55.384509 6406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "923be84939a24ef6a3ecb13a3f78180e"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "5229d661487e3b3162952b9158247184"
server_key_iv: "1ac40f753ddaa7fefaec61f6398bf93a"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.384559 6406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:55.398648 6406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:55.400992 6406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:55.401104 6406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:55.401340 6406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:32:55.401645 6406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:55.401707 6406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.401731 6406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:55.401743 6406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.412175 6406 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:43491
I20260924 17:32:55.412289 6535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:43491 every 8 connection(s)
I20260924 17:32:55.412637 6406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:55.420631 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 6406
I20260924 17:32:55.420746 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:32:55.420905 6292 external_mini_cluster.cc:1428] Setting key 7803fc4b6254111b48bf01bb720e5bae
I20260924 17:32:55.423518 6384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.413622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:59533 (local address 127.6.37.62:38155)
0924 17:32:55.413718 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:55.413721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:55.413978 (+ 257us) server_negotiation.cc:407] Connection header received
0924 17:32:55.414700 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:55.414701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:55.414716 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:55.414776 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:55.415971 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.416491 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.417565 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.417765 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.417824 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.420411 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:55.420413 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:55.420413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:55.420423 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:55.422028 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.422481 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.422483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.422483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.422547 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.422804 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.422805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.422806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.422981 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:55.423054 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:55.423335 (+ 281us) server_negotiation.cc:299] Negotiation successful
0924 17:32:55.423422 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260924 17:32:55.423815 6538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.413606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38155 (local address 127.6.37.1:59533)
0924 17:32:55.413839 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:55.413877 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:55.414575 (+ 698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:55.414854 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:55.414858 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:55.415611 (+ 753us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:55.415871 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:55.415876 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.416577 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.416578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:55.417478 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:55.417480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.417841 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.417841 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:55.417961 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.418499 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:55.418508 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:55.420278 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:55.422134 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:55.422142 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:55.422144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:55.422392 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:55.422621 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:55.422621 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:55.422622 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:55.422731 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:55.423045 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:55.423052 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:55.423199 (+ 147us) client_negotiation.cc:769] Sending connection context
0924 17:32:55.423317 (+ 118us) client_negotiation.cc:240] Negotiation successful
0924 17:32:55.423494 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":145,"threads_started":1}
I20260924 17:32:55.424563 6536 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38155
I20260924 17:32:55.424677 6536 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:55.424885 6536 heartbeater.cc:511] Master 127.6.37.62:38155 requested a full tablet report, sending...
I20260924 17:32:55.425802 6344 ts_manager.cc:194] Registered new tserver with Master: 923be84939a24ef6a3ecb13a3f78180e (127.6.37.1:43491)
I20260924 17:32:55.426999 6344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:59533
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:32:55.449707 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38155
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:55.552898 6541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:55.553109 6541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:55.553134 6541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:55.554323 6541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:55.554364 6541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:55.554392 6541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:32:55.555929 6541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38155
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:55.556182 6541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:55.556404 6541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:55.561678 6546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.561743 6549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.561743 6547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:55.562218 6541 server_base.cc:1034] running on GCE node
I20260924 17:32:55.562404 6541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:55.562641 6541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:55.563768 6541 hybrid_clock.cc:648] HybridClock initialized: now 1790271175563754 us; error 27 us; skew 500 ppm
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:55.566637 6541 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:32:55.567114 6541 webserver.cc:460] Webserver started at http://127.6.37.2:37885/ using document root <none> and password file <none>
I20260924 17:32:55.567338 6541 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:55.567400 6541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:55.567552 6541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:55.568707 6541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "329ca2afbaf8491e808647fd0c83186a"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "941468a18a2b7a5e2774e222a3b483ed"
server_key_iv: "4a9af5226c9a3faac1ef0ff88c443990"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.569131 6541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "329ca2afbaf8491e808647fd0c83186a"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "941468a18a2b7a5e2774e222a3b483ed"
server_key_iv: "4a9af5226c9a3faac1ef0ff88c443990"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.570567 6541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:32:55.571309 6556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.571472 6541 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.571570 6541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "329ca2afbaf8491e808647fd0c83186a"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "941468a18a2b7a5e2774e222a3b483ed"
server_key_iv: "4a9af5226c9a3faac1ef0ff88c443990"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.571638 6541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:55.587440 6541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:55.590175 6541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:55.590380 6541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:55.590770 6541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:32:55.591149 6541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:55.591204 6541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.591245 6541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:55.591269 6541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.601225 6541 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:42559
I20260924 17:32:55.601281 6670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:42559 every 8 connection(s)
I20260924 17:32:55.601644 6541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:32:55.604354 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 6541
I20260924 17:32:55.604455 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:32:55.604625 6292 external_mini_cluster.cc:1428] Setting key be3e428ba00150740d5ec808899ea9c7
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:55.613461 6384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.602388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:35057 (local address 127.6.37.62:38155)
0924 17:32:55.602440 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:55.602442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:55.602827 (+ 385us) server_negotiation.cc:407] Connection header received
0924 17:32:55.603506 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:55.603507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:55.603522 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:55.603579 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:55.604956 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.605610 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.607445 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.607761 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.607834 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.610456 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:55.610457 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:55.610457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:55.610463 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:55.611923 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.612467 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.612468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.612468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.612515 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.612830 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.612831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.612831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.612930 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:55.612988 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:55.613334 (+ 346us) server_negotiation.cc:299] Negotiation successful
0924 17:32:55.613396 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:32:55.613765 6673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.602386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38155 (local address 127.6.37.2:35057)
0924 17:32:55.602679 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:55.602715 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:55.603397 (+ 682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:55.603660 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:55.603663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:55.604433 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:55.604835 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:55.604842 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.605699 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.605701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:55.607364 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:55.607367 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.607851 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.607852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:55.607950 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.608522 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:55.608530 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:55.610359 (+ 1829us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:55.612027 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:55.612035 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:55.612038 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:55.612375 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:55.612580 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:55.612580 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:55.612581 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:55.612740 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:55.613014 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:55.613021 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:55.613195 (+ 174us) client_negotiation.cc:769] Sending connection context
0924 17:32:55.613322 (+ 127us) client_negotiation.cc:240] Negotiation successful
0924 17:32:55.613497 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":163,"threads_started":1}
I20260924 17:32:55.614354 6671 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38155
I20260924 17:32:55.614465 6671 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:55.614769 6671 heartbeater.cc:511] Master 127.6.37.62:38155 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
I20260924 17:32:55.615181 6344 ts_manager.cc:194] Registered new tserver with Master: 329ca2afbaf8491e808647fd0c83186a (127.6.37.2:42559)
I20260924 17:32:55.615573 6344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:35057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:32:55.633266 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38155
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:55.718788 6676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:55.719028 6676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:55.719071 6676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:55.720202 6676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:55.720265 6676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:55.720309 6676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:32:55.721732 6676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38155
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:55.721984 6676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:55.722204 6676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:55.727027 6682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.727028 6684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:55.727041 6681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:55.727623 6676 server_base.cc:1034] running on GCE node
I20260924 17:32:55.727794 6676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:55.727980 6676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:55.729144 6676 hybrid_clock.cc:648] HybridClock initialized: now 1790271175729127 us; error 28 us; skew 500 ppm
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:55.731655 6676 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:32:55.732086 6676 webserver.cc:460] Webserver started at http://127.6.37.3:39351/ using document root <none> and password file <none>
I20260924 17:32:55.732259 6676 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:55.732296 6676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:55.732396 6676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:55.733561 6676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "0bfb38e067b84fd18938d8a0b10bb77a"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "dcc821e614369edb9ad73c67afb49d7c"
server_key_iv: "afd5efcdae10062a3fda83fbd4b532fe"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.734071 6676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "0bfb38e067b84fd18938d8a0b10bb77a"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "dcc821e614369edb9ad73c67afb49d7c"
server_key_iv: "afd5efcdae10062a3fda83fbd4b532fe"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.735618 6676 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:32:55.736305 6691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.736495 6676 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:32:55.736579 6676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "0bfb38e067b84fd18938d8a0b10bb77a"
format_stamp: "Formatted at 2026-09-24 17:32:55 on dist-test-slave-gcz9"
server_key: "dcc821e614369edb9ad73c67afb49d7c"
server_key_iv: "afd5efcdae10062a3fda83fbd4b532fe"
server_key_version: "encryptionkey@0"
I20260924 17:32:55.736631 6676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:55.756922 6676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:55.759019 6676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:55.759168 6676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:55.759390 6676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:32:55.759696 6676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:55.759747 6676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.759825 6676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:55.759848 6676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:55.771687 6676 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38863
I20260924 17:32:55.771761 6804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38863 every 8 connection(s)
I20260924 17:32:55.772110 6676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:32:55.778226 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 6676
I20260924 17:32:55.778321 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:32:55.778491 6292 external_mini_cluster.cc:1428] Setting key f6e20bcc3e1cb4f1b0fd164d859eb756
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:55.783067 6384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.773083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:40121 (local address 127.6.37.62:38155)
0924 17:32:55.773130 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:55.773132 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:55.773355 (+ 223us) server_negotiation.cc:407] Connection header received
0924 17:32:55.774182 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:55.774184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:55.774199 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:55.774247 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:55.775416 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.775911 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.777167 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.777390 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.777475 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.780396 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:55.780397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:55.780397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:55.780405 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:55.781810 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.782166 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.782167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.782167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.782217 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.782421 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.782422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.782422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.782532 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:55.782582 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:55.782939 (+ 357us) server_negotiation.cc:299] Negotiation successful
0924 17:32:55.783004 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:32:55.783383 6807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.773042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38155 (local address 127.6.37.3:40121)
0924 17:32:55.773224 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:55.773268 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:55.774065 (+ 797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:55.774326 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:55.774330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:55.775029 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:55.775310 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:55.775316 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.776005 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.776006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:55.777067 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:55.777070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.777487 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.777488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:55.777679 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.778245 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:55.778255 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:55.780313 (+ 2058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:55.781883 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:55.781889 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:55.781891 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:55.782104 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:55.782269 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:55.782270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:55.782270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:55.782372 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:55.782614 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:55.782622 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:55.782749 (+ 127us) client_negotiation.cc:769] Sending connection context
0924 17:32:55.782863 (+ 114us) client_negotiation.cc:240] Negotiation successful
0924 17:32:55.783080 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260924 17:32:55.783981 6805 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38155
I20260924 17:32:55.784073 6805 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:55.784228 6805 heartbeater.cc:511] Master 127.6.37.62:38155 requested a full tablet report, sending...
I20260924 17:32:55.784578 6344 ts_manager.cc:194] Registered new tserver with Master: 0bfb38e067b84fd18938d8a0b10bb77a (127.6.37.3:38863)
I20260924 17:32:55.784958 6344 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:40121
I20260924 17:32:55.790773 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:32:55.815377 6812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.807917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52360 (local address 127.6.37.1:43491)
0924 17:32:55.808090 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:55.808095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:55.808105 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:32:55.808132 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:55.808134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:55.808148 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:55.808216 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:55.808763 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.809504 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.810200 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.810513 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.810568 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.812820 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:55.812827 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:55.812827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:55.812834 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:55.814340 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.814630 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.814633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.814633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.814685 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.814826 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.814826 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.814827 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.815027 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:55.815138 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:55.815193 (+ 55us) server_negotiation.cc:299] Negotiation successful
0924 17:32:55.815255 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
W20260924 17:32:55.815856 6450 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52360
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:32:55.837512 6812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:55.830464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52376 (local address 127.6.37.1:43491)
0924 17:32:55.830530 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:55.830532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:55.830621 (+ 89us) server_negotiation.cc:407] Connection header received
0924 17:32:55.830705 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:55.830706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:55.830723 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:55.830782 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:55.831391 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.831897 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.832620 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:55.832824 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:55.832906 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:55.835191 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:55.835192 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:55.835193 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:55.835200 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:55.836441 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.836771 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.836773 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.836773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.836829 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:55.837019 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:55.837020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:55.837020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:55.837117 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:55.837239 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:55.837328 (+ 89us) server_negotiation.cc:299] Negotiation successful
0924 17:32:55.837408 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:32:55.838128 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 6406
I20260924 17:32:55.842918 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 6541
I20260924 17:32:55.847714 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 6676
I20260924 17:32:55.852106 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 6312
2026-09-24T17:32:55Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2035 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6820](info): set up 2 sockets
Sep 24 17:32:55 dist-test-slave-gcz9 krb5kdc[6820](info): commencing operation
krb5kdc: starting...
W20260924 17:32:56.905299 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:32:56 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:32:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:32:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:32:57.025621 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40073
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:40073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:57.105777 6833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:57.105969 6833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:57.105990 6833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:57.107138 6833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:32:57.107177 6833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:57.107192 6833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:57.107205 6833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:32:57.107255 6833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:32:57.108726 6833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:40073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:57.108948 6833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:57.109172 6833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:32:57.113988 6833 server_base.cc:1034] running on GCE node
W20260924 17:32:57.113962 6838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.113983 6839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.113962 6841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:57.114459 6833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:57.114706 6833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:57.115847 6833 hybrid_clock.cc:648] HybridClock initialized: now 1790271177115841 us; error 41 us; skew 500 ppm
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:57.118253 6833 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:32:57.118716 6833 webserver.cc:460] Webserver started at http://127.6.37.62:38869/ using document root <none> and password file <none>
I20260924 17:32:57.118971 6833 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:57.119019 6833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:57.119153 6833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:57.120160 6833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "c7cb602a3e5c498b98065da5021ab6e0"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "352efedec8594c3d5d7372a3c1d5cea1"
server_key_iv: "4aaafc7aa6537f8c1a8a33f2c36bc059"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.120565 6833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "c7cb602a3e5c498b98065da5021ab6e0"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "352efedec8594c3d5d7372a3c1d5cea1"
server_key_iv: "4aaafc7aa6537f8c1a8a33f2c36bc059"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.121963 6833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:32:57.122761 6848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.123008 6833 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:32:57.123104 6833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "c7cb602a3e5c498b98065da5021ab6e0"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "352efedec8594c3d5d7372a3c1d5cea1"
server_key_iv: "4aaafc7aa6537f8c1a8a33f2c36bc059"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.123176 6833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:57.139101 6833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:57.140985 6833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:57.141122 6833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:57.145025 6833 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:40073
I20260924 17:32:57.145170 6900 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:40073 every 8 connection(s)
I20260924 17:32:57.145380 6833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:32:57.146212 6901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:57.148473 6901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0: Bootstrap starting.
I20260924 17:32:57.149075 6901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:57.149365 6901 log.cc:824] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:57.150061 6901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0: No bootstrap required, opened a new log
I20260924 17:32:57.150207 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 6833
I20260924 17:32:57.150296 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:32:57.150456 6292 external_mini_cluster.cc:1428] Setting key 1f04d4f4e273661777595889ebffe48b
I20260924 17:32:57.151938 6901 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb602a3e5c498b98065da5021ab6e0" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40073 } }
I20260924 17:32:57.152098 6901 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:57.152139 6901 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7cb602a3e5c498b98065da5021ab6e0, State: Initialized, Role: FOLLOWER
I20260924 17:32:57.152269 6901 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb602a3e5c498b98065da5021ab6e0" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40073 } }
I20260924 17:32:57.152359 6901 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:32:57.152395 6901 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:32:57.152446 6901 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:32:57.153491 6901 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb602a3e5c498b98065da5021ab6e0" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40073 } }
I20260924 17:32:57.153576 6901 leader_election.cc:302] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7cb602a3e5c498b98065da5021ab6e0; no voters:
I20260924 17:32:57.153762 6901 leader_election.cc:288] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:32:57.153795 6906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:32:57.153903 6906 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [term 1 LEADER]: Becoming Leader. State: Replica: c7cb602a3e5c498b98065da5021ab6e0, State: Running, Role: LEADER
I20260924 17:32:57.153981 6906 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb602a3e5c498b98065da5021ab6e0" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40073 } }
I20260924 17:32:57.154028 6901 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:32:57.154289 6908 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7cb602a3e5c498b98065da5021ab6e0. Latest consensus state: current_term: 1 leader_uuid: "c7cb602a3e5c498b98065da5021ab6e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb602a3e5c498b98065da5021ab6e0" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40073 } } }
I20260924 17:32:57.154366 6908 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [sys.catalog]: This master's current role is: LEADER
I20260924 17:32:57.154506 6907 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7cb602a3e5c498b98065da5021ab6e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7cb602a3e5c498b98065da5021ab6e0" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40073 } } }
I20260924 17:32:57.154551 6907 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0 [sys.catalog]: This master's current role is: LEADER
I20260924 17:32:57.154644 6911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:32:57.155139 6911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:32:57.157730 6911 catalog_manager.cc:1347] Generated new cluster ID: dcf587ecad5a47c28515027ae82cdcd0
I20260924 17:32:57.157783 6911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:57.162153 6905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.150962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34802 (local address 127.6.37.62:40073)
0924 17:32:57.151122 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.151130 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.151162 (+ 32us) server_negotiation.cc:407] Connection header received
0924 17:32:57.151922 (+ 760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.151928 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.151971 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.152088 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:57.152898 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.153946 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.155037 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.155636 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.155739 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.158494 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:57.158498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:57.158498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:57.158510 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:57.160485 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.160855 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.160858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.160859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.160982 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.161187 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.161189 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.161189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.161577 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:57.161738 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.161820 (+ 82us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.161960 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":82,"threads_started":1}
I20260924 17:32:57.176682 6911 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:32:57.177201 6911 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:32:57.179648 6911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7cb602a3e5c498b98065da5021ab6e0: Generated new TSK 0
I20260924 17:32:57.179814 6911 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:32:57.206503 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:40073
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:57.286561 6927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:57.286757 6927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:57.286782 6927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:57.288087 6927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:57.288154 6927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:57.288194 6927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:32:57.289791 6927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:40073
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:57.290033 6927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:57.290284 6927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:57.295192 6932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:57.295225 6927 server_base.cc:1034] running on GCE node
W20260924 17:32:57.295287 6935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.295199 6933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:57.295632 6927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:57.295843 6927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:57.297026 6927 hybrid_clock.cc:648] HybridClock initialized: now 1790271177297010 us; error 24 us; skew 500 ppm
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:57.299649 6927 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:32:57.300088 6927 webserver.cc:460] Webserver started at http://127.6.37.1:42151/ using document root <none> and password file <none>
I20260924 17:32:57.300284 6927 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:57.300333 6927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:57.300431 6927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:57.301400 6927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "83206b0b80d41bee73a45c1940214685"
server_key_iv: "dd214f357e57ec8e4b40c608ba765c11"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.301693 6927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "83206b0b80d41bee73a45c1940214685"
server_key_iv: "dd214f357e57ec8e4b40c608ba765c11"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.303134 6927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:32:57.303871 6942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.304070 6927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260924 17:32:57.304171 6927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "83206b0b80d41bee73a45c1940214685"
server_key_iv: "dd214f357e57ec8e4b40c608ba765c11"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.304245 6927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:57.315521 6927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:57.317427 6927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:57.317562 6927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:57.317777 6927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:32:57.318113 6927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:57.318146 6927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.318189 6927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:57.318215 6927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.323732 6927 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:34621
I20260924 17:32:57.323812 7057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:34621 every 8 connection(s)
I20260924 17:32:57.324105 6927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:57.331270 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 6927
I20260924 17:32:57.331386 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:32:57.331563 6292 external_mini_cluster.cc:1428] Setting key a90a4121aafe31c4598e76336a0b6caf
I20260924 17:32:57.333678 6905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.324815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:59055 (local address 127.6.37.62:40073)
0924 17:32:57.324871 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.324873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.325071 (+ 198us) server_negotiation.cc:407] Connection header received
0924 17:32:57.326232 (+ 1161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.326233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.326245 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.326306 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:57.326964 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.327453 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.328425 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.328628 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.328677 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.330683 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:57.330685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:57.330685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:57.330693 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:57.332293 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.332689 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.332691 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.332691 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.332752 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.332995 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.332996 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.332996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.333111 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:57.333182 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.333540 (+ 358us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.333614 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260924 17:32:57.333928 7060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.324794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40073 (local address 127.6.37.1:59055)
0924 17:32:57.324951 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.324991 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.326144 (+ 1153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.326363 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.326366 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.326610 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:57.326888 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.326893 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.327532 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.327533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.328351 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.328354 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.328707 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.328708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.328840 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.329265 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:57.329273 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:57.330598 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:57.332375 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:57.332381 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:57.332383 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:57.332607 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:57.332816 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:57.332817 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:57.332817 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:57.332925 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:57.333189 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:57.333197 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:57.333377 (+ 180us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.333502 (+ 125us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.333678 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260924 17:32:57.334444 7058 heartbeater.cc:347] Connected to a master server at 127.6.37.62:40073
I20260924 17:32:57.334543 7058 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:57.334717 7058 heartbeater.cc:511] Master 127.6.37.62:40073 requested a full tablet report, sending...
I20260924 17:32:57.335238 6865 ts_manager.cc:194] Registered new tserver with Master: a637c0c1c3dd4fdc9d5ec3eefe484e98 (127.6.37.1:34621)
I20260924 17:32:57.335840 6865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:59055
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:32:57.357450 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:40073
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:57.438835 7063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:57.439060 7063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:57.439085 7063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:57.440296 7063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:57.440342 7063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:57.440395 7063 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:32:57.441877 7063 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:40073
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7063
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:57.442106 7063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:57.442320 7063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:57.447175 7068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.447249 7069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.447386 7071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:57.447361 7063 server_base.cc:1034] running on GCE node
I20260924 17:32:57.447593 7063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:57.447777 7063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:57.448940 7063 hybrid_clock.cc:648] HybridClock initialized: now 1790271177448928 us; error 26 us; skew 500 ppm
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:57.451486 7063 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:32:57.451956 7063 webserver.cc:460] Webserver started at http://127.6.37.2:45205/ using document root <none> and password file <none>
I20260924 17:32:57.452183 7063 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:57.452247 7063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:57.452394 7063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:57.453403 7063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "15f82ce5cfb642719d6fb69ca9f8070b"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "c0506600348630d840a81030b971e1a8"
server_key_iv: "f5265e6a202a34eea01c2c240f0d021a"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.453761 7063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "15f82ce5cfb642719d6fb69ca9f8070b"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "c0506600348630d840a81030b971e1a8"
server_key_iv: "f5265e6a202a34eea01c2c240f0d021a"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.455282 7063 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:32:57.456025 7078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.456205 7063 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:32:57.456321 7063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "15f82ce5cfb642719d6fb69ca9f8070b"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "c0506600348630d840a81030b971e1a8"
server_key_iv: "f5265e6a202a34eea01c2c240f0d021a"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.456403 7063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:57.475346 7063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:57.477319 7063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:57.477481 7063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:57.477717 7063 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:32:57.478031 7063 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:57.478085 7063 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.478125 7063 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:57.478153 7063 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.483973 7063 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:38237
I20260924 17:32:57.484017 7191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:38237 every 8 connection(s)
I20260924 17:32:57.484366 7063 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:57.491868 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 7063
I20260924 17:32:57.491945 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:32:57.492115 6292 external_mini_cluster.cc:1428] Setting key ea7a4c2a1eac1af26a823a1a935bcb82
I20260924 17:32:57.495050 6905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.485101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:40781 (local address 127.6.37.62:40073)
0924 17:32:57.485186 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.485188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.485812 (+ 624us) server_negotiation.cc:407] Connection header received
0924 17:32:57.487223 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.487225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.487237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.487287 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:57.488189 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.488737 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.489750 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.489965 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.490027 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.492180 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:57.492182 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:57.492182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:57.492190 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:57.493599 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.494024 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.494026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.494026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.494086 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.494331 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.494332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.494332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.494443 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:57.494514 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.494780 (+ 266us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.494948 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:32:57.495177 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.485076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40073 (local address 127.6.37.2:40781)
0924 17:32:57.485653 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.485704 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.487027 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.487434 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.487439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.487842 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:57.488101 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.488107 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.488822 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.488823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.489668 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.489670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.490048 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.490048 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.490149 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.490589 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:57.490597 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:57.492090 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:57.493697 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:57.493705 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:57.493708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:57.493950 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:57.494157 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:57.494158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:57.494158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:57.494265 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:57.494507 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:57.494514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:57.494652 (+ 138us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.494757 (+ 105us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.494955 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":78,"threads_started":1}
I20260924 17:32:57.495602 7192 heartbeater.cc:347] Connected to a master server at 127.6.37.62:40073
I20260924 17:32:57.495705 7192 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:57.495885 7192 heartbeater.cc:511] Master 127.6.37.62:40073 requested a full tablet report, sending...
I20260924 17:32:57.496212 6865 ts_manager.cc:194] Registered new tserver with Master: 15f82ce5cfb642719d6fb69ca9f8070b (127.6.37.2:38237)
I20260924 17:32:57.496622 6865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:40781
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:32:57.518216 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:40073
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:57.598891 7197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:57.599087 7197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:57.599112 7197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:57.600221 7197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:57.600258 7197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:57.600284 7197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:32:57.601651 7197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:40073
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:57.601821 7197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:57.601984 7197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:57.606835 7205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.606920 7202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:57.606945 7203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:57.606971 7197 server_base.cc:1034] running on GCE node
I20260924 17:32:57.607228 7197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:57.607465 7197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:57.608603 7197 hybrid_clock.cc:648] HybridClock initialized: now 1790271177608589 us; error 30 us; skew 500 ppm
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:57.611052 7197 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:32:57.611449 7197 webserver.cc:460] Webserver started at http://127.6.37.3:35043/ using document root <none> and password file <none>
I20260924 17:32:57.611666 7197 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:57.611709 7197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:57.611850 7197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:57.612960 7197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "11e0fbc1190f46c98108fa03aecae34d"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "649db2eea1332e561b4d38b2eb7502e9"
server_key_iv: "b02880890adbeb751280bcd5f1dfd060"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.613339 7197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "11e0fbc1190f46c98108fa03aecae34d"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "649db2eea1332e561b4d38b2eb7502e9"
server_key_iv: "b02880890adbeb751280bcd5f1dfd060"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.614673 7197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:32:57.615417 7212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.615592 7197 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.615676 7197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "11e0fbc1190f46c98108fa03aecae34d"
format_stamp: "Formatted at 2026-09-24 17:32:57 on dist-test-slave-gcz9"
server_key: "649db2eea1332e561b4d38b2eb7502e9"
server_key_iv: "b02880890adbeb751280bcd5f1dfd060"
server_key_version: "encryptionkey@0"
I20260924 17:32:57.615746 7197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:57.626906 7197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:57.628690 7197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:57.628844 7197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:57.629070 7197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:32:57.629374 7197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:57.629421 7197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.629462 7197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:57.629490 7197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:57.635694 7197 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:42161
I20260924 17:32:57.635794 7327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:42161 every 8 connection(s)
I20260924 17:32:57.636065 7197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:32:57 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271177, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:57.642944 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 7197
I20260924 17:32:57.643050 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:32:57.643224 6292 external_mini_cluster.cc:1428] Setting key 4eb798c48b19047c31671298c15f28c3
I20260924 17:32:57.645803 6905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.636694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:44341 (local address 127.6.37.62:40073)
0924 17:32:57.636735 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.636737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.637006 (+ 269us) server_negotiation.cc:407] Connection header received
0924 17:32:57.637871 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.637872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.637883 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.637934 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:57.638483 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.639048 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.640040 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.640233 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.640280 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.642776 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:57.642778 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:57.642779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:57.642787 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:57.644541 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.644958 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.644959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.644959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.645025 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.645241 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.645242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.645242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.645369 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:57.645430 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.645659 (+ 229us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.645727 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:32:57.645951 7330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.636662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40073 (local address 127.6.37.3:44341)
0924 17:32:57.636871 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.636904 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.637778 (+ 874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.637986 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.637989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.638233 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:57.638418 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.638422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.639141 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.639142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.639976 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.639978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.640298 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.640298 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.640447 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.641037 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:57.641046 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:57.642663 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:57.644614 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:57.644620 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:57.644622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:57.644883 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:57.645089 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:57.645090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:57.645090 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:57.645184 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:57.645427 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:57.645431 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:57.645547 (+ 116us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.645626 (+ 79us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.645737 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":115,"threads_started":1}
I20260924 17:32:57.646400 7328 heartbeater.cc:347] Connected to a master server at 127.6.37.62:40073
I20260924 17:32:57.646530 7328 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:57.646754 7328 heartbeater.cc:511] Master 127.6.37.62:40073 requested a full tablet report, sending...
I20260924 17:32:57.647267 6865 ts_manager.cc:194] Registered new tserver with Master: 11e0fbc1190f46c98108fa03aecae34d (127.6.37.3:42161)
I20260924 17:32:57.647861 6865 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:44341
I20260924 17:32:57.655099 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:32:57.663574 6905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.657078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44432 (local address 127.6.37.62:40073)
0924 17:32:57.657142 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.657144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.657233 (+ 89us) server_negotiation.cc:407] Connection header received
0924 17:32:57.657272 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.657273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.657282 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.657349 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:57.657905 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.658388 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.659297 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.659505 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.659579 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.660926 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:57.660928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:57.660928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:57.660936 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:57.662425 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.662757 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.662758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.662759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.662817 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:57.663038 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:57.663039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:57.663040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:57.663184 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:57.663286 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.663397 (+ 111us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.663473 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:32:57.666246 6865 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44432:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:32:57.668187 6865 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:32:57.675724 7337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.670962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:34621 (local address 127.0.0.1:36312)
0924 17:32:57.671122 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.671161 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.671225 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.671461 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.671464 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.671466 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:57.671532 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.671534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.673127 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.673128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.674357 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.674359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.675302 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.675303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.675460 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.675479 (+ 19us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.675552 (+ 73us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.675614 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":42,"thread_start_us":60,"threads_started":1}
I20260924 17:32:57.675722 7340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.671217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39214 (local address 127.6.37.2:38237)
0924 17:32:57.671530 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.671535 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.671658 (+ 123us) server_negotiation.cc:407] Connection header received
0924 17:32:57.671722 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.671725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.671741 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.671812 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:57.672020 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.673224 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.674633 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.675375 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.675462 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.675515 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.675607 (+ 92us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.675645 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":159,"threads_started":1}
I20260924 17:32:57.675947 7338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.670978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:38237 (local address 127.0.0.1:39214)
0924 17:32:57.671534 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.671546 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.671594 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.671900 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.671901 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.671904 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:57.671955 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.671957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.673388 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.673389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.674550 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.674553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.675463 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.675464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.675529 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.675534 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.675593 (+ 59us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.675638 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":2,"thread_start_us":42,"threads_started":1}
I20260924 17:32:57.676177 7341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.671537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51570 (local address 127.6.37.3:42161)
0924 17:32:57.672096 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.672100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.672114 (+ 14us) server_negotiation.cc:407] Connection header received
0924 17:32:57.672145 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.672146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.672158 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.672252 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:57.672413 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.673059 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.674938 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.675576 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.675636 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.675693 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.676035 (+ 342us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.676088 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":166,"threads_started":1}
I20260924 17:32:57.675971 7336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.671001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:42161 (local address 127.0.0.1:51570)
0924 17:32:57.671866 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.671877 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.671929 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.672250 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.672251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.672252 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:57.672338 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.672340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.673243 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.673244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.674550 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.674553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.675725 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.675726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.675780 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.675784 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.675835 (+ 51us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.675882 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":850,"mutex_wait_us":59,"thread_start_us":63,"threads_started":1}
I20260924 17:32:57.676611 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.671072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36312 (local address 127.6.37.1:34621)
0924 17:32:57.671281 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.671285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.671295 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:32:57.671334 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.671335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.671347 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.671436 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:57.671627 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.673011 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.674447 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.675202 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.675276 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.675342 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.675686 (+ 344us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.675732 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":93,"threads_started":1}
I20260924 17:32:57.676975 7126 tablet_service.cc:1467] Processing CreateTablet for tablet a842ebb53262425e90bf762056098b6e (DEFAULT_TABLE table=test-table [id=ce1fa8940f0b4437b4ee3e01fcb9e9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:32:57.677155 7262 tablet_service.cc:1467] Processing CreateTablet for tablet a842ebb53262425e90bf762056098b6e (DEFAULT_TABLE table=test-table [id=ce1fa8940f0b4437b4ee3e01fcb9e9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:32:57.677279 7126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a842ebb53262425e90bf762056098b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:57.677505 7262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a842ebb53262425e90bf762056098b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:57.677505 6991 tablet_service.cc:1467] Processing CreateTablet for tablet a842ebb53262425e90bf762056098b6e (DEFAULT_TABLE table=test-table [id=ce1fa8940f0b4437b4ee3e01fcb9e9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:32:57.677795 6991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a842ebb53262425e90bf762056098b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:57.680732 7342 tablet_bootstrap.cc:492] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: Bootstrap starting.
I20260924 17:32:57.681348 7343 tablet_bootstrap.cc:492] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: Bootstrap starting.
I20260924 17:32:57.681707 7342 tablet_bootstrap.cc:654] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:57.681854 7344 tablet_bootstrap.cc:492] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: Bootstrap starting.
I20260924 17:32:57.682672 7343 tablet_bootstrap.cc:654] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:57.682792 7344 tablet_bootstrap.cc:654] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:57.683081 7342 log.cc:824] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:57.683784 7343 log.cc:824] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:57.683864 7344 log.cc:824] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:57.684196 7342 tablet_bootstrap.cc:492] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: No bootstrap required, opened a new log
I20260924 17:32:57.684252 7342 ts_tablet_manager.cc:1397] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260924 17:32:57.684653 7343 tablet_bootstrap.cc:492] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: No bootstrap required, opened a new log
I20260924 17:32:57.684711 7343 ts_tablet_manager.cc:1397] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:32:57.686856 7342 raft_consensus.cc:348] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.686971 7343 raft_consensus.cc:348] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.687176 7342 raft_consensus.cc:374] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:57.687224 7342 raft_consensus.cc:729] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f82ce5cfb642719d6fb69ca9f8070b, State: Initialized, Role: FOLLOWER
I20260924 17:32:57.687228 7343 raft_consensus.cc:374] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:57.687279 7343 raft_consensus.cc:729] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11e0fbc1190f46c98108fa03aecae34d, State: Initialized, Role: FOLLOWER
I20260924 17:32:57.687376 7342 consensus_queue.cc:260] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.687667 7342 ts_tablet_manager.cc:1428] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:32:57.687765 7344 tablet_bootstrap.cc:492] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: No bootstrap required, opened a new log
I20260924 17:32:57.687817 7192 heartbeater.cc:503] Master 127.6.37.62:40073 was elected leader, sending a full tablet report...
I20260924 17:32:57.687839 7344 ts_tablet_manager.cc:1397] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260924 17:32:57.691797 7344 raft_consensus.cc:348] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.692065 7344 raft_consensus.cc:374] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:57.692117 7344 raft_consensus.cc:729] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a637c0c1c3dd4fdc9d5ec3eefe484e98, State: Initialized, Role: FOLLOWER
I20260924 17:32:57.692245 7344 consensus_queue.cc:260] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.692543 7058 heartbeater.cc:503] Master 127.6.37.62:40073 was elected leader, sending a full tablet report...
I20260924 17:32:57.692550 7344 ts_tablet_manager.cc:1428] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260924 17:32:57.692948 7343 consensus_queue.cc:260] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.693392 7343 ts_tablet_manager.cc:1428] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260924 17:32:57.694422 7328 heartbeater.cc:503] Master 127.6.37.62:40073 was elected leader, sending a full tablet report...
W20260924 17:32:57.735018 7193 tablet.cc:2369] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:32:57.824872 7059 tablet.cc:2369] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:32:57.886771 7329 tablet.cc:2369] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:32:57.952175 7348 raft_consensus.cc:482] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:32:57.952309 7348 raft_consensus.cc:504] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.952914 7348 leader_election.cc:288] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a637c0c1c3dd4fdc9d5ec3eefe484e98 (127.6.37.1:34621), 11e0fbc1190f46c98108fa03aecae34d (127.6.37.3:42161)
I20260924 17:32:57.956389 7194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.953133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:34621 (local address 127.6.37.2:35897)
0924 17:32:57.953189 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.953200 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.953242 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.953398 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.953399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.953400 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:57.953570 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.953573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.954492 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.954493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.955473 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.955476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.956126 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.956127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.956206 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.956209 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.956269 (+ 60us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.956315 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":5}
I20260924 17:32:57.956390 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.953243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:35897 (local address 127.6.37.1:34621)
0924 17:32:57.953286 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.953288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.953296 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:32:57.953326 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.953326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.953338 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.953390 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:57.953671 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.954397 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.955570 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.956038 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.956129 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.956139 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.956275 (+ 136us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.956302 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:32:57.956981 7341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.953231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:50073 (local address 127.6.37.3:42161)
0924 17:32:57.953316 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:57.953318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:57.953561 (+ 243us) server_negotiation.cc:407] Connection header received
0924 17:32:57.953592 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:57.953594 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:57.953606 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:57.953662 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:57.953950 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.954470 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.955711 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.956427 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.956495 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.956507 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:57.956886 (+ 379us) server_negotiation.cc:299] Negotiation successful
0924 17:32:57.956923 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260924 17:32:57.957018 7351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:57.953162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:42161 (local address 127.6.37.2:50073)
0924 17:32:57.953443 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:57.953451 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:57.953509 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:57.953674 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:57.953675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:57.953677 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:57.953879 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.953881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.954549 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.954551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.955627 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:57.955630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:57.956629 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:57.956646 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:57.956780 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:57.956785 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:32:57.956875 (+ 90us) client_negotiation.cc:240] Negotiation successful
0924 17:32:57.956914 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":198,"threads_started":1}
I20260924 17:32:57.956964 7012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a842ebb53262425e90bf762056098b6e" candidate_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" is_pre_election: true
I20260924 17:32:57.957227 7012 raft_consensus.cc:2454] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f82ce5cfb642719d6fb69ca9f8070b in term 0.
I20260924 17:32:57.957484 7080 leader_election.cc:302] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15f82ce5cfb642719d6fb69ca9f8070b, a637c0c1c3dd4fdc9d5ec3eefe484e98; no voters:
I20260924 17:32:57.957688 7348 raft_consensus.cc:2781] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:32:57.957768 7348 raft_consensus.cc:482] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:32:57.957805 7348 raft_consensus.cc:3037] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:32:57.957767 7282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a842ebb53262425e90bf762056098b6e" candidate_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11e0fbc1190f46c98108fa03aecae34d" is_pre_election: true
I20260924 17:32:57.957931 7282 raft_consensus.cc:2454] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15f82ce5cfb642719d6fb69ca9f8070b in term 0.
I20260924 17:32:57.958923 7348 raft_consensus.cc:504] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.959084 7348 leader_election.cc:288] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [CANDIDATE]: Term 1 election: Requested vote from peers a637c0c1c3dd4fdc9d5ec3eefe484e98 (127.6.37.1:34621), 11e0fbc1190f46c98108fa03aecae34d (127.6.37.3:42161)
I20260924 17:32:57.959234 7282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a842ebb53262425e90bf762056098b6e" candidate_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11e0fbc1190f46c98108fa03aecae34d"
I20260924 17:32:57.959344 7282 raft_consensus.cc:3037] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:32:57.959372 7012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a842ebb53262425e90bf762056098b6e" candidate_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98"
I20260924 17:32:57.959544 7012 raft_consensus.cc:3037] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:32:57.960584 7282 raft_consensus.cc:2454] T a842ebb53262425e90bf762056098b6e P 11e0fbc1190f46c98108fa03aecae34d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f82ce5cfb642719d6fb69ca9f8070b in term 1.
I20260924 17:32:57.960597 7012 raft_consensus.cc:2454] T a842ebb53262425e90bf762056098b6e P a637c0c1c3dd4fdc9d5ec3eefe484e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15f82ce5cfb642719d6fb69ca9f8070b in term 1.
I20260924 17:32:57.960779 7081 leader_election.cc:302] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11e0fbc1190f46c98108fa03aecae34d, 15f82ce5cfb642719d6fb69ca9f8070b; no voters:
I20260924 17:32:57.960881 7348 raft_consensus.cc:2781] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:32:57.961006 7348 raft_consensus.cc:686] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [term 1 LEADER]: Becoming Leader. State: Replica: 15f82ce5cfb642719d6fb69ca9f8070b, State: Running, Role: LEADER
I20260924 17:32:57.961097 7348 consensus_queue.cc:237] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } }
I20260924 17:32:57.962064 6865 catalog_manager.cc:5495] T a842ebb53262425e90bf762056098b6e P 15f82ce5cfb642719d6fb69ca9f8070b reported cstate change: term changed from 0 to 1, leader changed from <none> to 15f82ce5cfb642719d6fb69ca9f8070b (127.6.37.2). New cstate: current_term: 1 leader_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f82ce5cfb642719d6fb69ca9f8070b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a637c0c1c3dd4fdc9d5ec3eefe484e98" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 34621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11e0fbc1190f46c98108fa03aecae34d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42161 } health_report { overall_health: UNKNOWN } } }
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271176, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:32:58.036361 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:58.028121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36318 (local address 127.6.37.1:34621)
0924 17:32:58.028206 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:58.028209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:58.028318 (+ 109us) server_negotiation.cc:407] Connection header received
0924 17:32:58.028396 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:58.028398 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:58.028409 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:58.028478 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:58.029111 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:58.029621 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:58.030433 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:58.030637 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:58.030713 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:58.033231 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:58.033247 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:58.033248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:58.033257 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:58.035134 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:58.035511 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:58.035516 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:58.035516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:58.035614 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:58.035813 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:58.035813 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:58.035814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:58.035965 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:58.036128 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:58.036169 (+ 41us) server_negotiation.cc:299] Negotiation successful
0924 17:32:58.036251 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271178, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271178, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:32:58.060169 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:58.052841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36326 (local address 127.6.37.1:34621)
0924 17:32:58.052909 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:58.052911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:58.052983 (+ 72us) server_negotiation.cc:407] Connection header received
0924 17:32:58.053090 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:58.053091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:58.053102 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:58.053171 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:58.053729 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:58.054206 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:58.055127 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:58.055357 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:58.055440 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:58.057590 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:58.057592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:58.057592 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:58.057600 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:58.059100 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:58.059468 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:58.059469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:58.059469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:58.059529 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:58.059756 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:58.059757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:58.059757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:58.059848 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:58.059920 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:58.060048 (+ 128us) server_negotiation.cc:299] Negotiation successful
0924 17:32:58.060106 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[6820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[6820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:32:58.082715 7339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:58.076077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36340 (local address 127.6.37.1:34621)
0924 17:32:58.076144 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:58.076146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:58.076238 (+ 92us) server_negotiation.cc:407] Connection header received
0924 17:32:58.076350 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:58.076351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:58.076362 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:58.076420 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:58.076943 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:58.077397 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:58.078088 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:58.078280 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:58.078368 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:58.080464 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:58.080465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:58.080465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:58.080473 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:58.081633 (+ 1160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:58.081995 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:58.081997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:58.081997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:58.082051 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:58.082238 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:58.082239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:58.082240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:58.082339 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:58.082442 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:58.082536 (+ 94us) server_negotiation.cc:299] Negotiation successful
0924 17:32:58.082610 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260924 17:32:58.083485 6970 tablet_service.cc:2908] Rejecting scan request for tablet a842ebb53262425e90bf762056098b6e: Uninitialized: clean time has not yet been initialized
I20260924 17:32:58.084411 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 6927
I20260924 17:32:58.089846 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 7063
I20260924 17:32:58.094565 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 7197
I20260924 17:32:58.099264 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 6833
2026-09-24T17:32:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2247 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[7366](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[7366](info): set up 2 sockets
Sep 24 17:32:58 dist-test-slave-gcz9 krb5kdc[7366](info): commencing operation
krb5kdc: starting...
W20260924 17:32:59.136240 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:32:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:32:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:32:59.253749 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33163
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:46843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:33163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:59.334757 7379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:59.334964 7379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:59.335004 7379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:59.336130 7379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:32:59.336171 7379 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260924 17:32:59.336184 7379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:59.336198 7379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:59.336210 7379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:32:59.336272 7379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:32:59.337776 7379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:33163
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:59.338014 7379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:59.338238 7379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:59.343062 7384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.343072 7387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.343076 7385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:59.343391 7379 server_base.cc:1034] running on GCE node
I20260924 17:32:59.343624 7379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:59.343914 7379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:59.345078 7379 hybrid_clock.cc:648] HybridClock initialized: now 1790271179345061 us; error 38 us; skew 500 ppm
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:59.359576 7379 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:32:59.360118 7379 webserver.cc:460] Webserver started at http://127.6.37.62:35489/ using document root <none> and password file <none>
I20260924 17:32:59.360379 7379 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:59.360448 7379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:59.360599 7379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:59.361716 7379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "eb978668469b4f6f96edbd90d4393fc2"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "e1526f43812d6ea9752cb57ef2cbcaf0"
server_key_iv: "6cee660ccc883dfcaeea8627fcfb3ea3"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.362208 7379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "eb978668469b4f6f96edbd90d4393fc2"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "e1526f43812d6ea9752cb57ef2cbcaf0"
server_key_iv: "6cee660ccc883dfcaeea8627fcfb3ea3"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.363824 7379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:32:59.364749 7394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.365027 7379 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:32:59.365155 7379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "eb978668469b4f6f96edbd90d4393fc2"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "e1526f43812d6ea9752cb57ef2cbcaf0"
server_key_iv: "6cee660ccc883dfcaeea8627fcfb3ea3"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.365319 7379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:59.379920 7379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:59.382189 7379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:59.382349 7379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:59.387353 7379 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:33163
I20260924 17:32:59.387401 7458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:33163 every 8 connection(s)
I20260924 17:32:59.387724 7379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:32:59.388355 7459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:59.388466 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 7379
I20260924 17:32:59.388556 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:32:59.388715 6292 external_mini_cluster.cc:1428] Setting key cb784569ab0744835f069f54d8e1e0da
I20260924 17:32:59.391965 7459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: Bootstrap starting.
I20260924 17:32:59.392658 7459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:59.392964 7459 log.cc:824] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:59.393724 7459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: No bootstrap required, opened a new log
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:59.396224 7459 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb978668469b4f6f96edbd90d4393fc2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33163 } }
I20260924 17:32:59.396437 7459 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:59.396513 7459 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb978668469b4f6f96edbd90d4393fc2, State: Initialized, Role: FOLLOWER
I20260924 17:32:59.396661 7459 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb978668469b4f6f96edbd90d4393fc2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33163 } }
I20260924 17:32:59.396731 7459 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:32:59.396781 7459 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:32:59.396826 7459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:32:59.397392 7459 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb978668469b4f6f96edbd90d4393fc2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33163 } }
I20260924 17:32:59.397516 7459 leader_election.cc:302] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb978668469b4f6f96edbd90d4393fc2; no voters:
I20260924 17:32:59.397709 7459 leader_election.cc:288] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:32:59.397744 7464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:32:59.397867 7464 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [term 1 LEADER]: Becoming Leader. State: Replica: eb978668469b4f6f96edbd90d4393fc2, State: Running, Role: LEADER
I20260924 17:32:59.397967 7464 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb978668469b4f6f96edbd90d4393fc2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33163 } }
I20260924 17:32:59.397995 7459 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:32:59.398406 7464 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb978668469b4f6f96edbd90d4393fc2. Latest consensus state: current_term: 1 leader_uuid: "eb978668469b4f6f96edbd90d4393fc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb978668469b4f6f96edbd90d4393fc2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33163 } } }
I20260924 17:32:59.398415 7465 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb978668469b4f6f96edbd90d4393fc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb978668469b4f6f96edbd90d4393fc2" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33163 } } }
I20260924 17:32:59.398509 7464 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [sys.catalog]: This master's current role is: LEADER
I20260924 17:32:59.398525 7465 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2 [sys.catalog]: This master's current role is: LEADER
W20260924 17:32:59.400040 7480 catalog_manager.cc:1558] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:32:59.400122 7480 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:32:59.400302 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.389234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.6.37.62:33163)
0924 17:32:59.389435 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.389445 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.389481 (+ 36us) server_negotiation.cc:407] Connection header received
0924 17:32:59.390026 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.390036 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.390102 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.390270 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.390840 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.392246 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.393029 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.393590 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.393712 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.396442 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.396447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.396447 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.396460 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.398510 (+ 2050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.398970 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.398973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.398973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.399078 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.399321 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.399322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.399322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.399630 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.399797 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.399887 (+ 90us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.400029 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
I20260924 17:32:59.400422 7471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:32:59.400589 7471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:32:59.402086 7471 catalog_manager.cc:1347] Generated new cluster ID: 9add2ab95f314e95a68b2df8eddaa0e0
I20260924 17:32:59.402134 7471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:32:59.417557 7471 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:32:59.418176 7471 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:32:59.425056 7471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: Generated new TSK 0
I20260924 17:32:59.425313 7471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:32:59.458644 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33163
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:46843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:59.548571 7485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:59.548768 7485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:59.548792 7485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:59.549896 7485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:59.549929 7485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:59.549949 7485 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:32:59.549968 7485 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:32:59.551388 7485 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:33163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:59.551574 7485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:59.551751 7485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:59.556640 7490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.556645 7493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.556727 7491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:59.556831 7485 server_base.cc:1034] running on GCE node
I20260924 17:32:59.557070 7485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:59.557260 7485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:59.558427 7485 hybrid_clock.cc:648] HybridClock initialized: now 1790271179558423 us; error 36 us; skew 500 ppm
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:59.560925 7485 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:32:59.561403 7485 webserver.cc:460] Webserver started at http://127.6.37.1:46821/ using document root <none> and password file <none>
I20260924 17:32:59.561638 7485 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:59.561702 7485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:59.561849 7485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:59.562958 7485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "3315586c57af4c00b4fa1f7a1dfa7699"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "c1fe6184bb45b6553a1d79c0049cf7b0"
server_key_iv: "370709e755a9917f078391377daf07a6"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.563320 7485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "3315586c57af4c00b4fa1f7a1dfa7699"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "c1fe6184bb45b6553a1d79c0049cf7b0"
server_key_iv: "370709e755a9917f078391377daf07a6"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.564584 7485 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:32:59.565353 7500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.565536 7485 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:32:59.565630 7485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "3315586c57af4c00b4fa1f7a1dfa7699"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "c1fe6184bb45b6553a1d79c0049cf7b0"
server_key_iv: "370709e755a9917f078391377daf07a6"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.565712 7485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:59.587420 7485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:59.589840 7485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:59.590001 7485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:59.590701 7485 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:59.590754 7485 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.590785 7485 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:59.590802 7485 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:59.598308 7485 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:32799
I20260924 17:32:59.598513 7615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:32799 every 8 connection(s)
I20260924 17:32:59.598783 7485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:32:59.601701 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.591179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:56833 (local address 127.6.37.62:33163)
0924 17:32:59.591250 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.591252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.591520 (+ 268us) server_negotiation.cc:407] Connection header received
0924 17:32:59.592285 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.592286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.592308 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.592367 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.593311 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.593836 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.595023 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.595245 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.595324 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.598435 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.598437 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.598437 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.598448 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.600145 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.600593 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.600595 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.600595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.600660 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.600984 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.600985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.600986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.601112 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.601192 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.601501 (+ 309us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.601599 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260924 17:32:59.601909 7509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.591172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.6.37.1:56833)
0924 17:32:59.591361 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.591417 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.592160 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.592455 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.592460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.592862 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:59.593201 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.593209 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.593938 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.593939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.594917 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.594924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.595336 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.595338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.595462 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.596048 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:59.596058 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:59.598292 (+ 2234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:59.600245 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.600253 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.600255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.600496 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.600732 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.600733 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.600733 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.600897 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.601183 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:59.601191 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:59.601347 (+ 156us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.601458 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.601632 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260924 17:32:59.602454 7616 heartbeater.cc:347] Connected to a master server at 127.6.37.62:33163
I20260924 17:32:59.602551 7616 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:59.602756 7616 heartbeater.cc:511] Master 127.6.37.62:33163 requested a full tablet report, sending...
I20260924 17:32:59.603374 7410 ts_manager.cc:194] Registered new tserver with Master: 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799)
I20260924 17:32:59.603996 7410 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:56833
I20260924 17:32:59.604511 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 7485
I20260924 17:32:59.604631 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:32:59.604856 6292 external_mini_cluster.cc:1428] Setting key ebd44bae916f9c7f103753ea2eb6dd9a
I20260924 17:32:59.611387 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.604418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:38895 (local address 127.6.37.62:33163)
0924 17:32:59.604465 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.604468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.605146 (+ 678us) server_negotiation.cc:407] Connection header received
0924 17:32:59.605231 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.605232 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.605242 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.605292 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.605692 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.606452 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.607665 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.607875 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.607948 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.608871 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.608872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.608873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.608879 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.610260 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.610608 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.610609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.610609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.610661 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.610856 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.610857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.610857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.610992 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.611073 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.611225 (+ 152us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.611299 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:32:59.611402 7622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.604334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.6.37.1:38895)
0924 17:32:59.605074 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.605084 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.605160 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.605295 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.605296 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.605516 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:59.605598 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.605600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.606561 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.606563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.607586 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.607589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.607947 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.607948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.608034 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.608457 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:59.608462 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:59.608768 (+ 306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:59.610356 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.610357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.610358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.610538 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.610731 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.610732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.610732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.610790 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.611064 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:59.611065 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:59.611119 (+ 54us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.611199 (+ 80us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.611301 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:32:59.633617 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33163
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:46843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:59.714388 7625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:59.714620 7625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:59.714660 7625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:59.715873 7625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:59.715938 7625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:59.715973 7625 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:32:59.716024 7625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:32:59.717473 7625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:33163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:59.717749 7625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:59.718000 7625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:59.722971 7630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.722973 7633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.722973 7631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:59.723423 7625 server_base.cc:1034] running on GCE node
I20260924 17:32:59.723640 7625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:59.723862 7625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:59.725023 7625 hybrid_clock.cc:648] HybridClock initialized: now 1790271179725015 us; error 37 us; skew 500 ppm
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:59.727478 7625 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:32:59.727962 7625 webserver.cc:460] Webserver started at http://127.6.37.2:33667/ using document root <none> and password file <none>
I20260924 17:32:59.728188 7625 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:59.728253 7625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:59.728397 7625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:59.729420 7625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "41934d01333fef1196123b67c32a362e"
server_key_iv: "e8e2784ee196011a047215db170ed677"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.729795 7625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "41934d01333fef1196123b67c32a362e"
server_key_iv: "e8e2784ee196011a047215db170ed677"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.731144 7625 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:32:59.731890 7640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.732080 7625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:32:59.732173 7625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "41934d01333fef1196123b67c32a362e"
server_key_iv: "e8e2784ee196011a047215db170ed677"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.732250 7625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:59.743366 7625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:59.745328 7625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:59.745484 7625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:59.746073 7625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:59.746133 7625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.746168 7625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:59.746186 7625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:59.753630 7625 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:38109
I20260924 17:32:59.753703 7757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:38109 every 8 connection(s)
I20260924 17:32:59.754045 7625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:32:59.755873 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.746471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:39309 (local address 127.6.37.62:33163)
0924 17:32:59.746545 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.746548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.746769 (+ 221us) server_negotiation.cc:407] Connection header received
0924 17:32:59.747305 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.747306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.747320 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.747408 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.748029 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.748531 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.749551 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.749751 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.749838 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.752883 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.752885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.752885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.752891 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.754698 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.755119 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.755120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.755120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.755177 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.755349 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.755350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.755350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.755451 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.755497 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.755724 (+ 227us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.755781 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:32:59.756026 7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.746467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.6.37.2:39309)
0924 17:32:59.746639 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.746679 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.747209 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.747455 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.747458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.747722 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:59.747925 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.747930 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.748624 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.748625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.749450 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.749453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.749843 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.749845 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.749960 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.750505 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:59.750517 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:59.752737 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:59.754769 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.754773 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.754774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.755057 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.755221 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.755222 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.755222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.755312 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.755519 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:59.755523 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:59.755633 (+ 110us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.755705 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.755818 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":103,"threads_started":1}
I20260924 17:32:59.756479 7758 heartbeater.cc:347] Connected to a master server at 127.6.37.62:33163
I20260924 17:32:59.756557 7758 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:59.756738 7758 heartbeater.cc:511] Master 127.6.37.62:33163 requested a full tablet report, sending...
I20260924 17:32:59.757149 7411 ts_manager.cc:194] Registered new tserver with Master: 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109)
I20260924 17:32:59.757663 7411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:39309
I20260924 17:32:59.757951 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 7625
I20260924 17:32:59.758049 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:32:59.758224 6292 external_mini_cluster.cc:1428] Setting key 6bb9672b1915c53bbc38114de9001c04
I20260924 17:32:59.763278 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.757425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.6.37.2:56639)
0924 17:32:59.757561 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.757572 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.757629 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.757778 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.757778 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.757970 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:59.758043 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.758046 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.758945 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.758951 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.759447 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.759448 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.759822 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.759823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.759897 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.760319 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:59.760324 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:59.760599 (+ 275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:59.762356 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.762357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.762357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.762513 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.762705 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.762705 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.762706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.762748 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.763061 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:59.763061 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:59.763093 (+ 32us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.763142 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.763212 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":89,"threads_started":1}
I20260924 17:32:59.763495 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.757501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:56639 (local address 127.6.37.62:33163)
0924 17:32:59.757542 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.757544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.757620 (+ 76us) server_negotiation.cc:407] Connection header received
0924 17:32:59.757682 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.757683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.757691 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.757770 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.758144 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.758809 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.759533 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.759740 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.759821 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.760705 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.760706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.760706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.760714 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.762225 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.762583 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.762584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.762585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.762646 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.762787 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.762788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.762788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.762995 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.763073 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.763172 (+ 99us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.763256 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:32:59.785972 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33163
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:46843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:32:59.867565 7767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:32:59.867751 7767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:32:59.867775 7767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:32:59.869030 7767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:32:59.869071 7767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:32:59.869091 7767 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:32:59.869108 7767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:32:59.870594 7767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:33163
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:32:59.870817 7767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:32:59.871061 7767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:32:59.875850 7772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.875860 7775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:32:59.875860 7773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:32:59.876099 7767 server_base.cc:1034] running on GCE node
I20260924 17:32:59.876278 7767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:32:59.876529 7767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:32:59.877686 7767 hybrid_clock.cc:648] HybridClock initialized: now 1790271179877666 us; error 29 us; skew 500 ppm
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:32:59.880088 7767 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:32:59.880529 7767 webserver.cc:460] Webserver started at http://127.6.37.3:33689/ using document root <none> and password file <none>
I20260924 17:32:59.880702 7767 fs_manager.cc:359] Metadata directory not provided
I20260924 17:32:59.880741 7767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:32:59.880827 7767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:32:59.881855 7767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "e03e059053d741a794cc727c287b75ce"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "9efe11000bc071ed72d02f46b38e3620"
server_key_iv: "1d245bc691ba54886d1f837dfe2cebc5"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.882145 7767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "e03e059053d741a794cc727c287b75ce"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "9efe11000bc071ed72d02f46b38e3620"
server_key_iv: "1d245bc691ba54886d1f837dfe2cebc5"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.883459 7767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:32:59.884083 7782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.884243 7767 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:32:59.884361 7767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "e03e059053d741a794cc727c287b75ce"
format_stamp: "Formatted at 2026-09-24 17:32:59 on dist-test-slave-gcz9"
server_key: "9efe11000bc071ed72d02f46b38e3620"
server_key_iv: "1d245bc691ba54886d1f837dfe2cebc5"
server_key_version: "encryptionkey@0"
I20260924 17:32:59.884444 7767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:32:59.908924 7767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:32:59.910741 7767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:32:59.910959 7767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:32:59.911520 7767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:32:59.911572 7767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:32:59.911612 7767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:32:59.911650 7767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:59.919050 7767 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:36211
I20260924 17:32:59.919118 7898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:36211 every 8 connection(s)
I20260924 17:32:59.919453 7767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:32:59.921010 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 7767
I20260924 17:32:59.921097 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:32:59.921257 6292 external_mini_cluster.cc:1428] Setting key b4d43b2a21ea5bc758fa056c99a41c0a
I20260924 17:32:59.921352 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.911870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:40189 (local address 127.6.37.62:33163)
0924 17:32:59.911918 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.911920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.912131 (+ 211us) server_negotiation.cc:407] Connection header received
0924 17:32:59.912598 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.912600 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.912614 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.912699 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.913434 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.914293 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.915559 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.915767 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.915850 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.918175 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.918176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.918177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.918185 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.919930 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.920373 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.920374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.920374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.920433 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.920691 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.920692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.920693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.920809 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.920895 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.921179 (+ 284us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.921265 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:32:59.921504 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.911861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.6.37.3:40189)
0924 17:32:59.912004 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.912044 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.912507 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.912748 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.912750 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.913057 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:59.913323 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.913329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.914399 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.914400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.915445 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.915448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.915873 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.915874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.916011 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.916504 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:59.916517 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:59.918078 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:59.920013 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.920019 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.920021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.920287 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.920500 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.920501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.920501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.920616 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.920881 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:59.920888 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:59.921031 (+ 143us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.921133 (+ 102us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.921286 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":80,"threads_started":1}
I20260924 17:32:59.922055 7899 heartbeater.cc:347] Connected to a master server at 127.6.37.62:33163
I20260924 17:32:59.922140 7899 heartbeater.cc:464] Registering TS with master...
I20260924 17:32:59.922350 7899 heartbeater.cc:511] Master 127.6.37.62:33163 requested a full tablet report, sending...
I20260924 17:32:59.922734 7411 ts_manager.cc:194] Registered new tserver with Master: e03e059053d741a794cc727c287b75ce (127.6.37.3:36211)
I20260924 17:32:59.923141 7411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:40189
I20260924 17:32:59.928380 7905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.923194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.6.37.3:43007)
0924 17:32:59.923308 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.923319 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.923397 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.923555 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.923556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.923697 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:32:59.923755 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.923756 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.924480 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.924481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.925005 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.925006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.925397 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.925398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.925454 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.925867 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:32:59.925872 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:32:59.926146 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:32:59.927566 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.927566 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.927567 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.927715 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.927931 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:32:59.927931 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:32:59.927931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:32:59.927977 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:32:59.928165 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:32:59.928166 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:32:59.928197 (+ 31us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.928246 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.928312 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":65,"threads_started":1}
I20260924 17:32:59.928392 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.923254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:43007 (local address 127.6.37.62:33163)
0924 17:32:59.923296 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.923298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.923370 (+ 72us) server_negotiation.cc:407] Connection header received
0924 17:32:59.923477 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.923478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.923489 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.923547 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.923826 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.924390 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.925095 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.925329 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.925388 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.926214 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.926214 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.926215 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.926220 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.927493 (+ 1273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.927816 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.927817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.927817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.927873 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.928026 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.928026 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.928026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.928119 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.928168 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.928273 (+ 105us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.928336 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260924 17:32:59.932909 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 17:32:59 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:32:59.955870 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.948994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37310 (local address 127.6.37.62:33163)
0924 17:32:59.949049 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.949051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.949060 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:32:59.949092 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.949092 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.949101 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.949157 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:32:59.949705 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.950192 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.950956 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.951152 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.951220 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.953728 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:32:59.953729 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:32:59.953730 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:32:59.953737 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:32:59.954964 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.955258 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.955259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.955259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.955315 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:32:59.955471 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:32:59.955472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:32:59.955472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:32:59.955571 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:32:59.955644 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.955724 (+ 80us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.955781 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260924 17:32:59.957624 7411 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:32:59.959250 7411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:32:59.965622 7916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.961390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:32799 (local address 127.0.0.1:45854)
0924 17:32:59.961554 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.961594 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.961662 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.961873 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.961876 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.961878 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:59.961959 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.961960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.963424 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.963425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.964415 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.964417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.965324 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.965325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.965382 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.965393 (+ 11us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.965475 (+ 82us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.965526 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":31,"thread_start_us":58,"threads_started":1}
I20260924 17:32:59.965643 7918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.961478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45854 (local address 127.6.37.1:32799)
0924 17:32:59.961682 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.961687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.961703 (+ 16us) server_negotiation.cc:407] Connection header received
0924 17:32:59.961749 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.961751 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.961767 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.961859 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:59.962156 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.963321 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.964494 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.965247 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.965325 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.965386 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.965494 (+ 108us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.965538 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":86,"threads_started":1}
I20260924 17:32:59.965721 7920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.961600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:36211 (local address 127.0.0.1:58640)
0924 17:32:59.961990 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.962009 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.962055 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.962346 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.962347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.962348 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:59.962415 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.962416 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.963304 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.963305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.964612 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.964615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.965484 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.965485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.965554 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.965558 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.965608 (+ 50us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.965648 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":6,"thread_start_us":67,"threads_started":1}
I20260924 17:32:59.965965 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.961793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.6.37.3:36211)
0924 17:32:59.962170 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.962174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.962183 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:32:59.962216 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.962218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.962232 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.962470 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:59.962514 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.963208 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.964710 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.965412 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.965478 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.965527 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.965798 (+ 271us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.965847 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":73,"threads_started":1}
I20260924 17:32:59.966497 7550 tablet_service.cc:1467] Processing CreateTablet for tablet 13841f76c4474b1c8795e7768cbee4d6 (DEFAULT_TABLE table=test-table [id=1bb944aec4bb457a84eabf9919a6e5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:32:59.966701 7917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.961390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:38109 (local address 127.0.0.1:43100)
0924 17:32:59.961650 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0924 17:32:59.961659 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:32:59.961700 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:32:59.961980 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:32:59.961981 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:32:59.961984 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:32:59.962035 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.962037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.963403 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.963404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.964613 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:32:59.964615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.966447 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.966448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:32:59.966520 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.966524 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:32:59.966595 (+ 71us) client_negotiation.cc:240] Negotiation successful
0924 17:32:59.966631 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":71,"thread_start_us":73,"threads_started":1}
I20260924 17:32:59.966631 7832 tablet_service.cc:1467] Processing CreateTablet for tablet 13841f76c4474b1c8795e7768cbee4d6 (DEFAULT_TABLE table=test-table [id=1bb944aec4bb457a84eabf9919a6e5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:32:59.966763 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:32:59.961479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43100 (local address 127.6.37.2:38109)
0924 17:32:59.961800 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0924 17:32:59.961804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:32:59.961818 (+ 14us) server_negotiation.cc:407] Connection header received
0924 17:32:59.961872 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:32:59.961874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:32:59.961888 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:32:59.961977 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:32:59.962103 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.963325 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.965564 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:32:59.966280 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:32:59.966348 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:32:59.966412 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:32:59.966628 (+ 216us) server_negotiation.cc:299] Negotiation successful
0924 17:32:59.966674 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":91,"threads_started":1}
I20260924 17:32:59.967032 7832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13841f76c4474b1c8795e7768cbee4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:59.967393 7550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13841f76c4474b1c8795e7768cbee4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:59.967338 7691 tablet_service.cc:1467] Processing CreateTablet for tablet 13841f76c4474b1c8795e7768cbee4d6 (DEFAULT_TABLE table=test-table [id=1bb944aec4bb457a84eabf9919a6e5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:32:59.967660 7691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13841f76c4474b1c8795e7768cbee4d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:32:59.971050 7922 tablet_bootstrap.cc:492] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Bootstrap starting.
I20260924 17:32:59.971315 7924 tablet_bootstrap.cc:492] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Bootstrap starting.
I20260924 17:32:59.971388 7923 tablet_bootstrap.cc:492] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Bootstrap starting.
I20260924 17:32:59.971930 7923 tablet_bootstrap.cc:654] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:59.972043 7922 tablet_bootstrap.cc:654] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:59.972083 7924 tablet_bootstrap.cc:654] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Neither blocks nor log segments found. Creating new log.
I20260924 17:32:59.972271 7923 log.cc:824] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:59.972473 7922 log.cc:824] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:59.972529 7924 log.cc:824] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Log is configured to *not* fsync() on all Append() calls
I20260924 17:32:59.973006 7923 tablet_bootstrap.cc:492] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: No bootstrap required, opened a new log
I20260924 17:32:59.973124 7923 ts_tablet_manager.cc:1397] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:32:59.973238 7922 tablet_bootstrap.cc:492] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: No bootstrap required, opened a new log
I20260924 17:32:59.973310 7922 ts_tablet_manager.cc:1397] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:32:59.973513 7924 tablet_bootstrap.cc:492] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: No bootstrap required, opened a new log
I20260924 17:32:59.973578 7924 ts_tablet_manager.cc:1397] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:32:59.975622 7923 raft_consensus.cc:348] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:32:59.975770 7923 raft_consensus.cc:374] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:59.975813 7923 raft_consensus.cc:729] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e9bcbf55c946d8a8c8fe5e4f4894d6, State: Initialized, Role: FOLLOWER
I20260924 17:32:59.976006 7923 consensus_queue.cc:260] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:32:59.975914 7922 raft_consensus.cc:348] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:32:59.976156 7922 raft_consensus.cc:374] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:59.976197 7922 raft_consensus.cc:729] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03e059053d741a794cc727c287b75ce, State: Initialized, Role: FOLLOWER
I20260924 17:32:59.976270 7923 ts_tablet_manager.cc:1428] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:32:59.976395 7758 heartbeater.cc:503] Master 127.6.37.62:33163 was elected leader, sending a full tablet report...
I20260924 17:32:59.976372 7922 consensus_queue.cc:260] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:32:59.976687 7922 ts_tablet_manager.cc:1428] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260924 17:32:59.976744 7899 heartbeater.cc:503] Master 127.6.37.62:33163 was elected leader, sending a full tablet report...
I20260924 17:32:59.977609 7924 raft_consensus.cc:348] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:32:59.977773 7924 raft_consensus.cc:374] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:32:59.977808 7924 raft_consensus.cc:729] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3315586c57af4c00b4fa1f7a1dfa7699, State: Initialized, Role: FOLLOWER
I20260924 17:32:59.977916 7924 consensus_queue.cc:260] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:32:59.978235 7924 ts_tablet_manager.cc:1428] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20260924 17:32:59.978276 7616 heartbeater.cc:503] Master 127.6.37.62:33163 was elected leader, sending a full tablet report...
W20260924 17:33:00.004709 7759 tablet.cc:2369] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:33:00.051010 7929 raft_consensus.cc:482] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:00.051193 7929 raft_consensus.cc:504] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.051678 7929 leader_election.cc:288] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799), 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109)
I20260924 17:33:00.055220 7918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.052020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:52995 (local address 127.6.37.1:32799)
0924 17:33:00.052080 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.052090 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.052101 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:33:00.052136 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.052137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.052147 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.052224 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:00.052488 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.053281 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.054403 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.054771 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.054850 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.054862 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.055114 (+ 252us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.055156 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260924 17:33:00.055222 7791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.051881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:32799 (local address 127.6.37.3:52995)
0924 17:33:00.051950 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.051965 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.052022 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.052232 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.052233 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.052235 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:00.052401 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.052404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.053382 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.053384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.054311 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.054313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.054859 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.054860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.055034 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.055038 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.055107 (+ 69us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.055149 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":24}
I20260924 17:33:00.055485 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.052187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:44547 (local address 127.6.37.2:38109)
0924 17:33:00.052246 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.052248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.052258 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:00.052330 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.052331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.052343 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.052408 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:00.052632 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.053326 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.054603 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.055052 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.055146 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.055156 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.055340 (+ 184us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.055397 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:33:00.055639 7570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13841f76c4474b1c8795e7768cbee4d6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" is_pre_election: true
I20260924 17:33:00.055729 7931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.051893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:38109 (local address 127.6.37.3:44547)
0924 17:33:00.052188 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.052199 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.052250 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.052421 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.052422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.052423 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:00.052547 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.052549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.053438 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.053439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.054504 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.054507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.055151 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.055152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.055228 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.055231 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.055597 (+ 366us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.055649 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":15,"thread_start_us":130,"threads_started":1}
I20260924 17:33:00.055821 7570 raft_consensus.cc:2454] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 0.
I20260924 17:33:00.056093 7785 leader_election.cc:302] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3315586c57af4c00b4fa1f7a1dfa7699, e03e059053d741a794cc727c287b75ce; no voters:
I20260924 17:33:00.056231 7711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13841f76c4474b1c8795e7768cbee4d6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" is_pre_election: true
I20260924 17:33:00.056313 7929 raft_consensus.cc:2781] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:00.056402 7929 raft_consensus.cc:482] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:00.056384 7711 raft_consensus.cc:2454] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 0.
I20260924 17:33:00.056428 7929 raft_consensus.cc:3037] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.057595 7929 raft_consensus.cc:504] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.057773 7929 leader_election.cc:288] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 election: Requested vote from peers 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799), 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109)
I20260924 17:33:00.057925 7711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13841f76c4474b1c8795e7768cbee4d6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6"
I20260924 17:33:00.057967 7570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13841f76c4474b1c8795e7768cbee4d6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3315586c57af4c00b4fa1f7a1dfa7699"
I20260924 17:33:00.058013 7711 raft_consensus.cc:3037] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.058044 7570 raft_consensus.cc:3037] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.059208 7711 raft_consensus.cc:2454] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 1.
I20260924 17:33:00.059274 7570 raft_consensus.cc:2454] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 1.
I20260924 17:33:00.059916 7784 leader_election.cc:302] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e9bcbf55c946d8a8c8fe5e4f4894d6, e03e059053d741a794cc727c287b75ce; no voters:
I20260924 17:33:00.060065 7929 raft_consensus.cc:2781] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:00.060204 7929 raft_consensus.cc:686] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 1 LEADER]: Becoming Leader. State: Replica: e03e059053d741a794cc727c287b75ce, State: Running, Role: LEADER
I20260924 17:33:00.060277 7929 consensus_queue.cc:237] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.061239 7410 catalog_manager.cc:5495] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce reported cstate change: term changed from 0 to 1, leader changed from <none> to e03e059053d741a794cc727c287b75ce (127.6.37.3). New cstate: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } health_report { overall_health: HEALTHY } } }
I20260924 17:33:00.083257 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.080208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58652 (local address 127.6.37.3:36211)
0924 17:33:00.080295 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.080297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.080332 (+ 35us) server_negotiation.cc:407] Connection header received
0924 17:33:00.080446 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.080447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.080470 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.080548 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:00.080697 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.081511 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.082313 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.082526 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.082609 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.082806 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.082982 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.083080 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.083135 (+ 55us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.083155 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260924 17:33:00.085534 7570 raft_consensus.cc:1261] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Refusing update from remote peer e03e059053d741a794cc727c287b75ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:00.085950 7932 consensus_queue.cc:1035] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:00.087528 7711 raft_consensus.cc:1261] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Refusing update from remote peer e03e059053d741a794cc727c287b75ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:00.087806 7932 consensus_queue.cc:1035] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:00.089763 7936 mvcc.cc:205] Tried to move back new op lower bound from 7332950753626857472 to 7332950753527660544. Current Snapshot: MvccSnapshot[applied={T|T < 7332950753626857472}]
I20260924 17:33:00.089942 7935 mvcc.cc:205] Tried to move back new op lower bound from 7332950753626857472 to 7332950753527660544. Current Snapshot: MvccSnapshot[applied={T|T < 7332950753626857472}]
I20260924 17:33:00.094964 7410 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:00.095110 7410 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:00.095958 7410 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: Sending DeleteTablet for 3 replicas of tablet 13841f76c4474b1c8795e7768cbee4d6
I20260924 17:33:00.096375 7832 tablet_service.cc:1514] Processing DeleteTablet for tablet 13841f76c4474b1c8795e7768cbee4d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:00 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:58640
I20260924 17:33:00.096403 7550 tablet_service.cc:1514] Processing DeleteTablet for tablet 13841f76c4474b1c8795e7768cbee4d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:00 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:45854
I20260924 17:33:00.096405 7691 tablet_service.cc:1514] Processing DeleteTablet for tablet 13841f76c4474b1c8795e7768cbee4d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:00 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:43100
I20260924 17:33:00.096704 7945 tablet_replica.cc:330] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: stopping tablet replica
I20260924 17:33:00.096837 7945 raft_consensus.cc:2229] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:00.097020 7410 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:00.097178 7410 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:00.097220 7945 raft_consensus.cc:2258] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:00.097749 7945 ts_tablet_manager.cc:1905] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:00.098656 7691 tablet_service.cc:1467] Processing CreateTablet for tablet 676d1ac8b54045e9957c7b054d998d44 (DEFAULT_TABLE table=test-table [id=a75409d675a5436b91bd2b31a6749321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:00.098690 7832 tablet_service.cc:1467] Processing CreateTablet for tablet 676d1ac8b54045e9957c7b054d998d44 (DEFAULT_TABLE table=test-table [id=a75409d675a5436b91bd2b31a6749321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:00.098773 7691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 676d1ac8b54045e9957c7b054d998d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:00.098778 7832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 676d1ac8b54045e9957c7b054d998d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:00.100272 7945 ts_tablet_manager.cc:1918] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:00.100399 7945 log.cc:1196] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/13841f76c4474b1c8795e7768cbee4d6
I20260924 17:33:00.100585 7923 tablet_bootstrap.cc:492] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Bootstrap starting.
I20260924 17:33:00.100756 7550 tablet_service.cc:1467] Processing CreateTablet for tablet 676d1ac8b54045e9957c7b054d998d44 (DEFAULT_TABLE table=test-table [id=a75409d675a5436b91bd2b31a6749321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:00.100873 7550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 676d1ac8b54045e9957c7b054d998d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:00.101274 7923 tablet_bootstrap.cc:654] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:00.102178 7923 tablet_bootstrap.cc:492] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: No bootstrap required, opened a new log
I20260924 17:33:00.102228 7923 ts_tablet_manager.cc:1397] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:00.102427 7923 raft_consensus.cc:348] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.102506 7923 raft_consensus.cc:374] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:00.102528 7923 raft_consensus.cc:729] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e9bcbf55c946d8a8c8fe5e4f4894d6, State: Initialized, Role: FOLLOWER
I20260924 17:33:00.102538 7924 tablet_bootstrap.cc:492] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Bootstrap starting.
I20260924 17:33:00.102568 7923 consensus_queue.cc:260] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.102674 7923 ts_tablet_manager.cc:1428] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:00.103012 7945 ts_tablet_manager.cc:1939] T 13841f76c4474b1c8795e7768cbee4d6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Deleting consensus metadata
I20260924 17:33:00.103510 7922 tablet_bootstrap.cc:492] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Bootstrap starting.
I20260924 17:33:00.103693 7924 tablet_bootstrap.cc:654] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:00.104097 7922 tablet_bootstrap.cc:654] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:00.104434 7396 catalog_manager.cc:4841] TS 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109): tablet 13841f76c4474b1c8795e7768cbee4d6 (table test-table [id=1bb944aec4bb457a84eabf9919a6e5d2]) successfully deleted
I20260924 17:33:00.104614 7946 tablet_replica.cc:330] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: stopping tablet replica
I20260924 17:33:00.104807 7947 tablet_replica.cc:330] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: stopping tablet replica
I20260924 17:33:00.104923 7947 raft_consensus.cc:2229] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:00.105033 7947 raft_consensus.cc:2258] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:00.105284 7922 tablet_bootstrap.cc:492] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: No bootstrap required, opened a new log
I20260924 17:33:00.105358 7946 raft_consensus.cc:2229] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:00.105422 7947 ts_tablet_manager.cc:1905] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:00.105477 7946 raft_consensus.cc:2258] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:00.105537 7922 ts_tablet_manager.cc:1397] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:00.105851 7922 raft_consensus.cc:348] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.105908 7924 tablet_bootstrap.cc:492] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: No bootstrap required, opened a new log
I20260924 17:33:00.105971 7924 ts_tablet_manager.cc:1397] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:33:00.105976 7922 raft_consensus.cc:374] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:00.106037 7922 raft_consensus.cc:729] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03e059053d741a794cc727c287b75ce, State: Initialized, Role: FOLLOWER
I20260924 17:33:00.106213 7922 consensus_queue.cc:260] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.106333 7924 raft_consensus.cc:348] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.106406 7924 raft_consensus.cc:374] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:00.106438 7924 raft_consensus.cc:729] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3315586c57af4c00b4fa1f7a1dfa7699, State: Initialized, Role: FOLLOWER
I20260924 17:33:00.106492 7922 ts_tablet_manager.cc:1428] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:00.106490 7924 consensus_queue.cc:260] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.106576 7924 ts_tablet_manager.cc:1428] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:00.105899 7946 ts_tablet_manager.cc:1905] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:00.107412 7947 ts_tablet_manager.cc:1918] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:00.107487 7947 log.cc:1196] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/13841f76c4474b1c8795e7768cbee4d6
I20260924 17:33:00.107738 7947 ts_tablet_manager.cc:1939] T 13841f76c4474b1c8795e7768cbee4d6 P e03e059053d741a794cc727c287b75ce: Deleting consensus metadata
I20260924 17:33:00.108109 7397 catalog_manager.cc:4841] TS e03e059053d741a794cc727c287b75ce (127.6.37.3:36211): tablet 13841f76c4474b1c8795e7768cbee4d6 (table test-table [id=1bb944aec4bb457a84eabf9919a6e5d2]) successfully deleted
I20260924 17:33:00.108668 7946 ts_tablet_manager.cc:1918] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:00.108743 7946 log.cc:1196] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/13841f76c4474b1c8795e7768cbee4d6
I20260924 17:33:00.109030 7946 ts_tablet_manager.cc:1939] T 13841f76c4474b1c8795e7768cbee4d6 P 3315586c57af4c00b4fa1f7a1dfa7699: Deleting consensus metadata
I20260924 17:33:00.109457 7397 catalog_manager.cc:4841] TS 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799): tablet 13841f76c4474b1c8795e7768cbee4d6 (table test-table [id=1bb944aec4bb457a84eabf9919a6e5d2]) successfully deleted
W20260924 17:33:00.169976 7900 tablet.cc:2369] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:33:00.282166 7930 raft_consensus.cc:482] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:00.282294 7930 raft_consensus.cc:504] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.282667 7930 leader_election.cc:288] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109), e03e059053d741a794cc727c287b75ce (127.6.37.3:36211)
I20260924 17:33:00.286942 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.282948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:50889 (local address 127.6.37.3:36211)
0924 17:33:00.283002 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.283005 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.283080 (+ 75us) server_negotiation.cc:407] Connection header received
0924 17:33:00.283145 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.283147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.283165 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.283236 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:00.283493 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.284269 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.285917 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.286521 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.286596 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.286605 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.286796 (+ 191us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.286851 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:00.286993 7919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.282957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:55735 (local address 127.6.37.2:38109)
0924 17:33:00.283006 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.283008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.283079 (+ 71us) server_negotiation.cc:407] Connection header received
0924 17:33:00.283146 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.283147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.283157 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.283236 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:00.283528 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.284279 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.285917 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.286490 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.286573 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.286587 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.286847 (+ 260us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.286918 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260924 17:33:00.286962 7951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.282852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:36211 (local address 127.6.37.1:50889)
0924 17:33:00.283002 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.283013 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.283082 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.283252 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.283253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.283256 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:00.283373 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.283376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.284363 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.284363 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.285811 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.285815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.286599 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.286600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.286696 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.286702 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.286764 (+ 62us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.286816 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":90,"thread_start_us":81,"threads_started":1}
I20260924 17:33:00.287005 7952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.282852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:38109 (local address 127.6.37.1:55735)
0924 17:33:00.283009 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.283019 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.283082 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.283252 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.283253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.283255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:00.283439 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.283441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.284364 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.284364 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.285811 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.285815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.286618 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.286619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.286726 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.286729 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.286780 (+ 51us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.286816 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":81,"thread_start_us":80,"threads_started":1}
I20260924 17:33:00.287225 7711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676d1ac8b54045e9957c7b054d998d44" candidate_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" is_pre_election: true
I20260924 17:33:00.287312 7711 raft_consensus.cc:2454] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3315586c57af4c00b4fa1f7a1dfa7699 in term 0.
I20260924 17:33:00.287467 7852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676d1ac8b54045e9957c7b054d998d44" candidate_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03e059053d741a794cc727c287b75ce" is_pre_election: true
I20260924 17:33:00.287518 7502 leader_election.cc:302] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e9bcbf55c946d8a8c8fe5e4f4894d6, 3315586c57af4c00b4fa1f7a1dfa7699; no voters:
I20260924 17:33:00.287621 7852 raft_consensus.cc:2454] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3315586c57af4c00b4fa1f7a1dfa7699 in term 0.
I20260924 17:33:00.287658 7930 raft_consensus.cc:2781] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:00.287695 7930 raft_consensus.cc:482] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:00.287719 7930 raft_consensus.cc:3037] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.288583 7930 raft_consensus.cc:504] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.288780 7930 leader_election.cc:288] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [CANDIDATE]: Term 1 election: Requested vote from peers 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109), e03e059053d741a794cc727c287b75ce (127.6.37.3:36211)
I20260924 17:33:00.288946 7852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676d1ac8b54045e9957c7b054d998d44" candidate_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e03e059053d741a794cc727c287b75ce"
I20260924 17:33:00.288933 7711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "676d1ac8b54045e9957c7b054d998d44" candidate_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6"
I20260924 17:33:00.289023 7711 raft_consensus.cc:3037] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.289022 7852 raft_consensus.cc:3037] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.289950 7711 raft_consensus.cc:2454] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3315586c57af4c00b4fa1f7a1dfa7699 in term 1.
I20260924 17:33:00.289950 7852 raft_consensus.cc:2454] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3315586c57af4c00b4fa1f7a1dfa7699 in term 1.
I20260924 17:33:00.290182 7503 leader_election.cc:302] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3315586c57af4c00b4fa1f7a1dfa7699, e03e059053d741a794cc727c287b75ce; no voters:
I20260924 17:33:00.290336 7930 raft_consensus.cc:2781] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:00.290485 7930 raft_consensus.cc:686] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 LEADER]: Becoming Leader. State: Replica: 3315586c57af4c00b4fa1f7a1dfa7699, State: Running, Role: LEADER
I20260924 17:33:00.290575 7930 consensus_queue.cc:237] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.291355 7411 catalog_manager.cc:5495] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1). New cstate: current_term: 1 leader_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } health_report { overall_health: UNKNOWN } } }
W20260924 17:33:00.355263 7617 tablet.cc:2369] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 24 17:33:00 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:00.366127 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.359680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.6.37.62:33163)
0924 17:33:00.359731 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.359733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.359869 (+ 136us) server_negotiation.cc:407] Connection header received
0924 17:33:00.359948 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.359949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.359958 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.360014 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:00.360441 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.360927 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.361610 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.361789 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.361842 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.363805 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:00.363806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:00.363806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:00.363812 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:00.365185 (+ 1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:00.365525 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:00.365526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:00.365526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:00.365574 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:00.365727 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:00.365727 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:00.365728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:00.365822 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:00.365870 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.365986 (+ 116us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.366060 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":28}
I20260924 17:33:00.366230 7960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.359602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33163 (local address 127.0.0.1:37322)
0924 17:33:00.359791 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.359800 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.359867 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.360028 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.360029 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.360324 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:00.360375 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.360377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.360996 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.360997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.361541 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.361542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.361852 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.361852 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.361899 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.362373 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:00.362378 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:00.363729 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:00.365255 (+ 1526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:00.365262 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:00.365264 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:00.365455 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:00.365626 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:00.365627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:00.365627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:00.365680 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:00.365870 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:00.365876 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:00.365921 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.365972 (+ 51us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.366121 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":62,"thread_start_us":93,"threads_started":1}
I20260924 17:33:00.368279 7411 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:37322:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260924 17:33:00.368570 7411 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:00.370026 7550 tablet_service.cc:1467] Processing CreateTablet for tablet 1de6932c81a64eb8975bbb3f56ee0df6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6acbcbdb8da2464a807f2b9e64459a66]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:00.370024 7691 tablet_service.cc:1467] Processing CreateTablet for tablet 1de6932c81a64eb8975bbb3f56ee0df6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6acbcbdb8da2464a807f2b9e64459a66]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:00.370024 7832 tablet_service.cc:1467] Processing CreateTablet for tablet 1de6932c81a64eb8975bbb3f56ee0df6 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6acbcbdb8da2464a807f2b9e64459a66]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:00.370235 7550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de6932c81a64eb8975bbb3f56ee0df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:00.370236 7832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de6932c81a64eb8975bbb3f56ee0df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:00.370236 7691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1de6932c81a64eb8975bbb3f56ee0df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:00.371728 7924 tablet_bootstrap.cc:492] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: Bootstrap starting.
I20260924 17:33:00.372061 7923 tablet_bootstrap.cc:492] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Bootstrap starting.
I20260924 17:33:00.372071 7922 tablet_bootstrap.cc:492] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: Bootstrap starting.
I20260924 17:33:00.372375 7924 tablet_bootstrap.cc:654] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:00.372465 7922 tablet_bootstrap.cc:654] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:00.372553 7923 tablet_bootstrap.cc:654] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:00.373203 7923 tablet_bootstrap.cc:492] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: No bootstrap required, opened a new log
I20260924 17:33:00.373224 7922 tablet_bootstrap.cc:492] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: No bootstrap required, opened a new log
I20260924 17:33:00.373263 7922 ts_tablet_manager.cc:1397] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:00.373262 7923 ts_tablet_manager.cc:1397] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:00.373535 7922 raft_consensus.cc:348] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.373597 7923 raft_consensus.cc:348] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.373644 7922 raft_consensus.cc:374] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:00.373667 7922 raft_consensus.cc:729] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e03e059053d741a794cc727c287b75ce, State: Initialized, Role: FOLLOWER
I20260924 17:33:00.373668 7923 raft_consensus.cc:374] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:00.373690 7923 raft_consensus.cc:729] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e9bcbf55c946d8a8c8fe5e4f4894d6, State: Initialized, Role: FOLLOWER
I20260924 17:33:00.373720 7922 consensus_queue.cc:260] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.373749 7923 consensus_queue.cc:260] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.373837 7922 ts_tablet_manager.cc:1428] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260924 17:33:00.373908 7923 ts_tablet_manager.cc:1428] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:00.373873 7942 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.373974 7942 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.374066 7928 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.374176 7928 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.374785 7924 tablet_bootstrap.cc:492] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: No bootstrap required, opened a new log
I20260924 17:33:00.374842 7924 ts_tablet_manager.cc:1397] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260924 17:33:00.375168 7924 raft_consensus.cc:348] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.375240 7924 raft_consensus.cc:374] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:00.375255 7924 raft_consensus.cc:729] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3315586c57af4c00b4fa1f7a1dfa7699, State: Initialized, Role: FOLLOWER
I20260924 17:33:00.375316 7924 consensus_queue.cc:260] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.375423 7924 ts_tablet_manager.cc:1428] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260924 17:33:00.375464 7930 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.375540 7930 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.637040 7942 raft_consensus.cc:482] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:00.637144 7942 raft_consensus.cc:504] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.637353 7942 leader_election.cc:288] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799), 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109)
I20260924 17:33:00.637606 7570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de6932c81a64eb8975bbb3f56ee0df6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" is_pre_election: true
I20260924 17:33:00.637606 7711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de6932c81a64eb8975bbb3f56ee0df6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" is_pre_election: true
I20260924 17:33:00.637705 7570 raft_consensus.cc:2454] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 0.
I20260924 17:33:00.637719 7711 raft_consensus.cc:2454] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 0.
I20260924 17:33:00.637892 7785 leader_election.cc:302] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3315586c57af4c00b4fa1f7a1dfa7699, e03e059053d741a794cc727c287b75ce; no voters:
I20260924 17:33:00.638005 7942 raft_consensus.cc:2781] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:00.638060 7942 raft_consensus.cc:482] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:00.638077 7942 raft_consensus.cc:3037] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.638770 7942 raft_consensus.cc:504] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.638985 7942 leader_election.cc:288] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 election: Requested vote from peers 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799), 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109)
I20260924 17:33:00.639137 7570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de6932c81a64eb8975bbb3f56ee0df6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3315586c57af4c00b4fa1f7a1dfa7699"
I20260924 17:33:00.639139 7711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1de6932c81a64eb8975bbb3f56ee0df6" candidate_uuid: "e03e059053d741a794cc727c287b75ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6"
I20260924 17:33:00.639212 7711 raft_consensus.cc:3037] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.639227 7570 raft_consensus.cc:3037] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:00.639860 7570 raft_consensus.cc:2454] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 1.
I20260924 17:33:00.639873 7711 raft_consensus.cc:2454] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e03e059053d741a794cc727c287b75ce in term 1.
I20260924 17:33:00.640074 7785 leader_election.cc:302] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3315586c57af4c00b4fa1f7a1dfa7699, e03e059053d741a794cc727c287b75ce; no voters:
I20260924 17:33:00.640178 7942 raft_consensus.cc:2781] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:00.640285 7942 raft_consensus.cc:686] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [term 1 LEADER]: Becoming Leader. State: Replica: e03e059053d741a794cc727c287b75ce, State: Running, Role: LEADER
I20260924 17:33:00.640352 7942 consensus_queue.cc:237] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } }
I20260924 17:33:00.640704 7964 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: TxnStatusTablet state changed. Reason: New leader e03e059053d741a794cc727c287b75ce. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.640861 7964 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:00.641047 7966 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260924 17:33:00.641089 7410 catalog_manager.cc:5495] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce reported cstate change: term changed from 0 to 1, leader changed from <none> to e03e059053d741a794cc727c287b75ce (127.6.37.3). New cstate: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } health_report { overall_health: HEALTHY } } }
I20260924 17:33:00.645782 7966 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260924 17:33:00.657258 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.654349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58654 (local address 127.6.37.3:36211)
0924 17:33:00.654391 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.654393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.654447 (+ 54us) server_negotiation.cc:407] Connection header received
0924 17:33:00.654565 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.654566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.654578 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.654633 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:00.654801 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.655351 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.656456 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.656664 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.656729 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.656950 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.656981 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.657036 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.657130 (+ 94us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.657155 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:33:00.657255 7960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.654303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:36211 (local address 127.0.0.1:58654)
0924 17:33:00.654398 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.654410 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.654468 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.654664 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.654665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.654666 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:00.654726 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.654728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.655428 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.655429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.656372 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.656376 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.656748 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.656749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.656829 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.656847 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.657054 (+ 207us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.657063 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.657119 (+ 56us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.657168 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260924 17:33:00.658488 7711 raft_consensus.cc:1261] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Refusing update from remote peer e03e059053d741a794cc727c287b75ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:00.658499 7570 raft_consensus.cc:1261] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Refusing update from remote peer e03e059053d741a794cc727c287b75ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:00.658717 7964 consensus_queue.cc:1035] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:00.658811 7942 consensus_queue.cc:1035] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:00.659483 7928 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: TxnStatusTablet state changed. Reason: New leader e03e059053d741a794cc727c287b75ce. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.659572 7928 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.659523 7930 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: TxnStatusTablet state changed. Reason: New leader e03e059053d741a794cc727c287b75ce. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.659613 7930 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.660382 7930 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.660468 7930 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P 3315586c57af4c00b4fa1f7a1dfa7699: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.660418 7942 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.660495 7942 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:00.661634 7964 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.661783 7964 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P e03e059053d741a794cc727c287b75ce: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:00.661998 7928 tablet_replica.cc:439] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e03e059053d741a794cc727c287b75ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3315586c57af4c00b4fa1f7a1dfa7699" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 32799 } } peers { permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 } } peers { permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 } } }
I20260924 17:33:00.662087 7928 tablet_replica.cc:442] T 1de6932c81a64eb8975bbb3f56ee0df6 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:00.662240 7970 mvcc.cc:205] Tried to move back new op lower bound from 7332950755975532544 to 7332950755903389696. Current Snapshot: MvccSnapshot[applied={T|T < 7332950755975532544}]
I20260924 17:33:00.665742 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.662837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45860 (local address 127.6.37.1:32799)
0924 17:33:00.662960 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.662962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.662973 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:33:00.663056 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.663057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.663080 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.663178 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:00.663256 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.663979 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.664785 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.665129 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.665204 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.665326 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.665453 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.665527 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.665546 (+ 19us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.665567 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":81,"threads_started":1}
I20260924 17:33:00.670734 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.668237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:46995 (local address 127.6.37.3:36211)
0924 17:33:00.668300 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.668302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.668480 (+ 178us) server_negotiation.cc:407] Connection header received
0924 17:33:00.668507 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.668508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.668517 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.668554 (+ 37us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:00.668734 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.669154 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.670037 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.670226 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.670302 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.670500 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.670534 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.670590 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.670652 (+ 62us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.670672 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:33:00.670770 7983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.668200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:36211 (local address 127.6.37.1:46995)
0924 17:33:00.668363 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.668375 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.668443 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.668589 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.668590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.668592 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:00.668669 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.668670 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.669233 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.669234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.669955 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.669957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.670296 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.670297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.670388 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.670402 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.670592 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.670595 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.670647 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.670691 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260924 17:33:00.673108 7711 raft_consensus.cc:1261] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Refusing update from remote peer 3315586c57af4c00b4fa1f7a1dfa7699: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:00.673161 7852 raft_consensus.cc:1261] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Refusing update from remote peer 3315586c57af4c00b4fa1f7a1dfa7699: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:00.673378 7953 consensus_queue.cc:1035] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19e9bcbf55c946d8a8c8fe5e4f4894d6" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 38109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:00.673554 7953 consensus_queue.cc:1035] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e03e059053d741a794cc727c287b75ce" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 36211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:00.682825 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.680473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:36641 (local address 127.6.37.1:32799)
0924 17:33:00.680530 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.680532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.680540 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:00.680563 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.680564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.680573 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.680634 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:00.680752 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.681205 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.682082 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.682373 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.682452 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.682596 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.682631 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.682694 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.682729 (+ 35us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.682749 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:33:00.682904 7988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.680284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:32799 (local address 127.6.37.3:36641)
0924 17:33:00.680441 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:00.680451 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:00.680511 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:00.680636 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:00.680637 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:00.680639 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:00.680695 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.680696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.681279 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.681280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.682013 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:00.682016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.682451 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.682452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:00.682506 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.682518 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:00.682692 (+ 174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:00.682693 (+ 1us) client_negotiation.cc:769] Sending connection context
0924 17:33:00.682723 (+ 30us) client_negotiation.cc:240] Negotiation successful
0924 17:33:00.682754 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
I20260924 17:33:00.693456 7410 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:00.693580 7410 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:00.694182 7410 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb978668469b4f6f96edbd90d4393fc2: Sending DeleteTablet for 3 replicas of tablet 676d1ac8b54045e9957c7b054d998d44
I20260924 17:33:00.694443 7550 tablet_service.cc:1514] Processing DeleteTablet for tablet 676d1ac8b54045e9957c7b054d998d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:00 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:45854
I20260924 17:33:00.694479 7691 tablet_service.cc:1514] Processing DeleteTablet for tablet 676d1ac8b54045e9957c7b054d998d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:00 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:43100
I20260924 17:33:00.694761 7992 tablet_replica.cc:330] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: stopping tablet replica
I20260924 17:33:00.694798 7832 tablet_service.cc:1514] Processing DeleteTablet for tablet 676d1ac8b54045e9957c7b054d998d44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:00 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:58640
I20260924 17:33:00.694821 7992 raft_consensus.cc:2229] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:00.694936 7992 raft_consensus.cc:2258] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:00.695226 7992 ts_tablet_manager.cc:1905] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:00.697449 7992 ts_tablet_manager.cc:1918] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:00.697540 7992 log.cc:1196] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/676d1ac8b54045e9957c7b054d998d44
I20260924 17:33:00.697830 7992 ts_tablet_manager.cc:1939] T 676d1ac8b54045e9957c7b054d998d44 P 3315586c57af4c00b4fa1f7a1dfa7699: Deleting consensus metadata
I20260924 17:33:00.698164 7397 catalog_manager.cc:4841] TS 3315586c57af4c00b4fa1f7a1dfa7699 (127.6.37.1:32799): tablet 676d1ac8b54045e9957c7b054d998d44 (table test-table [id=a75409d675a5436b91bd2b31a6749321]) successfully deleted
I20260924 17:33:00.702126 7991 tablet_replica.cc:330] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: stopping tablet replica
I20260924 17:33:00.702229 7991 raft_consensus.cc:2229] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:00.702283 7991 raft_consensus.cc:2258] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:00.702430 7994 tablet_replica.cc:330] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: stopping tablet replica
I20260924 17:33:00.702584 7991 ts_tablet_manager.cc:1905] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:00.702533 7994 raft_consensus.cc:2229] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:00.702693 7994 raft_consensus.cc:2258] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:00.703266 7994 ts_tablet_manager.cc:1905] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:00.707008 7994 ts_tablet_manager.cc:1918] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:00.707100 7994 log.cc:1196] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/676d1ac8b54045e9957c7b054d998d44
I20260924 17:33:00.707360 7994 ts_tablet_manager.cc:1939] T 676d1ac8b54045e9957c7b054d998d44 P e03e059053d741a794cc727c287b75ce: Deleting consensus metadata
I20260924 17:33:00.707722 7397 catalog_manager.cc:4841] TS e03e059053d741a794cc727c287b75ce (127.6.37.3:36211): tablet 676d1ac8b54045e9957c7b054d998d44 (table test-table [id=a75409d675a5436b91bd2b31a6749321]) successfully deleted
I20260924 17:33:00.707861 7991 ts_tablet_manager.cc:1918] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:00.707926 7991 log.cc:1196] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/676d1ac8b54045e9957c7b054d998d44
I20260924 17:33:00.708175 7991 ts_tablet_manager.cc:1939] T 676d1ac8b54045e9957c7b054d998d44 P 19e9bcbf55c946d8a8c8fe5e4f4894d6: Deleting consensus metadata
I20260924 17:33:00.708505 7396 catalog_manager.cc:4841] TS 19e9bcbf55c946d8a8c8fe5e4f4894d6 (127.6.37.2:38109): tablet 676d1ac8b54045e9957c7b054d998d44 (table test-table [id=a75409d675a5436b91bd2b31a6749321]) successfully deleted
Sep 24 17:33:00 dist-test-slave-gcz9 krb5kdc[7366](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271179, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:33:00.713929 7980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.703044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45868 (local address 127.6.37.1:32799)
0924 17:33:00.703103 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.703105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.703303 (+ 198us) server_negotiation.cc:407] Connection header received
0924 17:33:00.703497 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.703498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.703511 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.703541 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:00.704426 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.705156 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.706369 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.706633 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.706695 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.710780 (+ 4085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:00.710794 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:00.710795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:00.710801 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:00.712706 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:00.713061 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:00.713065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:00.713065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:00.713140 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:00.713352 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:00.713353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:00.713354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:00.713523 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:00.713689 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.713727 (+ 38us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.713810 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
W20260924 17:33:00.714351 7610 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45868
I20260924 17:33:00.721572 7462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:00.715396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37324 (local address 127.6.37.62:33163)
0924 17:33:00.715455 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:00.715458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:00.715613 (+ 155us) server_negotiation.cc:407] Connection header received
0924 17:33:00.715677 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:00.715678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:00.715690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:00.715751 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:00.716298 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.716813 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.717499 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:00.717694 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:00.717776 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:00.719010 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:00.719011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:00.719012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:00.719019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:00.720474 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:00.720810 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:00.720811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:00.720812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:00.720873 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:00.721064 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:00.721065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:00.721065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:00.721179 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:00.721282 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:00.721384 (+ 102us) server_negotiation.cc:299] Negotiation successful
0924 17:33:00.721458 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260924 17:33:00.721796 7410 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37324
I20260924 17:33:00.722379 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 7485
I20260924 17:33:00.728801 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 7625
I20260924 17:33:00.735186 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 7767
I20260924 17:33:00.741400 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 7379
2026-09-24T17:33:00Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2643 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:00 dist-test-slave-gcz9 krb5kdc[8000](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:00 dist-test-slave-gcz9 krb5kdc[8000](info): set up 2 sockets
Sep 24 17:33:00 dist-test-slave-gcz9 krb5kdc[8000](info): commencing operation
krb5kdc: starting...
W20260924 17:33:01.804601 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:01 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:01.929498 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:44215
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:44215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:02.010797 8013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:02.011097 8013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:02.011121 8013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:02.012238 8013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:02.012274 8013 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260924 17:33:02.012286 8013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:02.012300 8013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:02.012312 8013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:02.012323 8013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:02.013867 8013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:44215
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:44215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:02.014063 8013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:02.014225 8013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:02.019047 8019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:02.019075 8018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.019287 8013 server_base.cc:1034] running on GCE node
W20260924 17:33:02.019330 8021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.019671 8013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:02.019924 8013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:02.021067 8013 hybrid_clock.cc:648] HybridClock initialized: now 1790271182021046 us; error 41 us; skew 500 ppm
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:02.023648 8013 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:02.024159 8013 webserver.cc:460] Webserver started at http://127.6.37.62:41947/ using document root <none> and password file <none>
I20260924 17:33:02.024401 8013 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:02.024447 8013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:02.024574 8013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:02.025671 8013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "223e9ed9eae34df688dfb4929c90f8d7"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "d60a0b3720f6c09e068d953f409dd7c2"
server_key_iv: "2a281a139de1013f5fb9fc81c2d48151"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.026053 8013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "223e9ed9eae34df688dfb4929c90f8d7"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "d60a0b3720f6c09e068d953f409dd7c2"
server_key_iv: "2a281a139de1013f5fb9fc81c2d48151"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.027529 8013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260924 17:33:02.028287 8028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.028647 8013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:02.028760 8013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "223e9ed9eae34df688dfb4929c90f8d7"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "d60a0b3720f6c09e068d953f409dd7c2"
server_key_iv: "2a281a139de1013f5fb9fc81c2d48151"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.028838 8013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:02.041280 8013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:02.043370 8013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:02.043542 8013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:02.048625 8013 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:44215
I20260924 17:33:02.048664 8090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:44215 every 8 connection(s)
I20260924 17:33:02.049046 8013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:02.049682 8091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.052137 8091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Bootstrap starting.
I20260924 17:33:02.052753 8091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.053057 8091 log.cc:824] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:02.053807 8091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: No bootstrap required, opened a new log
I20260924 17:33:02.054518 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8013
I20260924 17:33:02.054610 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:02.054776 6292 external_mini_cluster.cc:1428] Setting key fc20211d0adceab42ca7bf156ab7fde8
I20260924 17:33:02.056479 8091 raft_consensus.cc:348] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223e9ed9eae34df688dfb4929c90f8d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44215 } }
I20260924 17:33:02.056654 8091 raft_consensus.cc:374] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.056721 8091 raft_consensus.cc:729] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223e9ed9eae34df688dfb4929c90f8d7, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.056887 8091 consensus_queue.cc:260] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223e9ed9eae34df688dfb4929c90f8d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44215 } }
I20260924 17:33:02.056968 8091 raft_consensus.cc:388] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:02.056991 8091 raft_consensus.cc:482] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:02.057061 8091 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:02.057605 8091 raft_consensus.cc:504] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223e9ed9eae34df688dfb4929c90f8d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44215 } }
I20260924 17:33:02.057730 8091 leader_election.cc:302] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 223e9ed9eae34df688dfb4929c90f8d7; no voters:
I20260924 17:33:02.057909 8091 leader_election.cc:288] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:02.057958 8096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:02.058154 8096 raft_consensus.cc:686] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [term 1 LEADER]: Becoming Leader. State: Replica: 223e9ed9eae34df688dfb4929c90f8d7, State: Running, Role: LEADER
I20260924 17:33:02.058179 8091 sys_catalog.cc:564] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:02.058302 8096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223e9ed9eae34df688dfb4929c90f8d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44215 } }
I20260924 17:33:02.058952 8098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 223e9ed9eae34df688dfb4929c90f8d7. Latest consensus state: current_term: 1 leader_uuid: "223e9ed9eae34df688dfb4929c90f8d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223e9ed9eae34df688dfb4929c90f8d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44215 } } }
I20260924 17:33:02.059044 8098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:02.059258 8097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "223e9ed9eae34df688dfb4929c90f8d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223e9ed9eae34df688dfb4929c90f8d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44215 } } }
I20260924 17:33:02.059365 8097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:02.059639 8105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:02.060184 8105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:02.061761 8105 catalog_manager.cc:1347] Generated new cluster ID: 2b3314559f3742aaa673e0818545eedb
I20260924 17:33:02.061812 8105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271181, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:02.067072 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.055342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.6.37.62:44215)
0924 17:33:02.055543 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.055552 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.055578 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:33:02.056457 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.056464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.056533 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.056675 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.057425 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.058732 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.059893 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.060390 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.060531 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.063355 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.063359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.063359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.063371 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.065362 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.065788 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.065791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.065792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.065919 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.066141 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.066142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.066142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.066424 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.066586 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.066729 (+ 143us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.066861 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260924 17:33:02.070071 8105 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:02.070755 8105 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:02.081566 8105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Generated new TSK 0
I20260924 17:33:02.081750 8105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:33:02.110581 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44215
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:02.193023 8117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:02.193244 8117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:02.193279 8117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:02.194494 8117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:02.194546 8117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:02.194571 8117 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260924 17:33:02.194583 8117 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:33:02.194602 8117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:02.196197 8117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:44215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:02.196444 8117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:02.196709 8117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:02.202198 8122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:02.202162 8123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.202178 8117 server_base.cc:1034] running on GCE node
W20260924 17:33:02.202159 8125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.202626 8117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:02.202939 8117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:02.204097 8117 hybrid_clock.cc:648] HybridClock initialized: now 1790271182204074 us; error 39 us; skew 500 ppm
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:02.206665 8117 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:33:02.207163 8117 webserver.cc:460] Webserver started at http://127.6.37.1:44183/ using document root <none> and password file <none>
I20260924 17:33:02.207392 8117 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:02.207461 8117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:02.207620 8117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:02.208665 8117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "0fab16ca0ba547dda4b270ce2c88ea9f"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "84ceb600ba4e608d2e2f22e04fa4e985"
server_key_iv: "37ec0d2ff01f2606a062ef221750d2cf"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.209043 8117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "0fab16ca0ba547dda4b270ce2c88ea9f"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "84ceb600ba4e608d2e2f22e04fa4e985"
server_key_iv: "37ec0d2ff01f2606a062ef221750d2cf"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.210392 8117 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:33:02.211228 8132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.211439 8117 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:02.211556 8117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "0fab16ca0ba547dda4b270ce2c88ea9f"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "84ceb600ba4e608d2e2f22e04fa4e985"
server_key_iv: "37ec0d2ff01f2606a062ef221750d2cf"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.211635 8117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:02.220702 8117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:02.222759 8117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:02.222959 8117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:02.223580 8117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:02.223641 8117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.223701 8117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:02.223729 8117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:02.231387 8117 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:43523
I20260924 17:33:02.231549 8249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:43523 every 8 connection(s)
I20260924 17:33:02.231861 8117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:02.234514 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.224019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:37691 (local address 127.6.37.62:44215)
0924 17:33:02.224090 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.224092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.224399 (+ 307us) server_negotiation.cc:407] Connection header received
0924 17:33:02.225177 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.225179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.225196 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.225250 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.226194 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.226960 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.228663 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.228894 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.228993 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.231752 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.231753 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.231754 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.231765 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.233373 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.233737 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.233738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.233738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.233792 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.233986 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.233986 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.233987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.234091 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.234141 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.234382 (+ 241us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.234451 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:33:02.234676 8141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.224024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.6.37.1:37691)
0924 17:33:02.224233 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.224288 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.225035 (+ 747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.225340 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.225344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.225750 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.226082 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.226090 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.227063 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.227064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.228561 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.228565 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.229023 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.229024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.229190 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.229737 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.229748 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.231652 (+ 1904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.233442 (+ 1790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.233447 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.233449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.233667 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.233851 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.233852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.233852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.233934 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.234150 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.234155 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.234270 (+ 115us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.234352 (+ 82us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.234471 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
I20260924 17:33:02.235185 8250 heartbeater.cc:347] Connected to a master server at 127.6.37.62:44215
I20260924 17:33:02.235323 8250 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:02.235433 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8117
I20260924 17:33:02.235532 8250 heartbeater.cc:511] Master 127.6.37.62:44215 requested a full tablet report, sending...
I20260924 17:33:02.235541 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:02.235754 6292 external_mini_cluster.cc:1428] Setting key aee49c2a90644aa7040508ca658ec3af
I20260924 17:33:02.236094 8044 ts_manager.cc:194] Registered new tserver with Master: 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523)
I20260924 17:33:02.236780 8044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:37691
I20260924 17:33:02.243680 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.237237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:38887 (local address 127.6.37.62:44215)
0924 17:33:02.237283 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.237285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.237959 (+ 674us) server_negotiation.cc:407] Connection header received
0924 17:33:02.237986 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.237987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.237999 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.238051 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.238343 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.239097 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.239760 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.240103 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.240194 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.241214 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.241215 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.241215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.241221 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.242540 (+ 1319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.242970 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.242972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.242972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.243033 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.243244 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.243244 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.243244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.243342 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.243392 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.243554 (+ 162us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.243623 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:33:02.243767 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.237206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.6.37.1:38887)
0924 17:33:02.237839 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.237851 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.237917 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.238062 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.238063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.238212 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.238269 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.238270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.239183 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.239184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.239670 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.239672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.240205 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.240206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.240260 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.240689 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.240693 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.241120 (+ 427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.242628 (+ 1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.242629 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.242629 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.242861 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.243110 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.243111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.243112 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.243177 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.243409 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.243410 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.243456 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.243540 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.243646 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":118,"threads_started":1}
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:33:02.263139 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44215
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:02.348358 8259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:02.348634 8259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:02.348685 8259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:02.350004 8259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:02.350083 8259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:02.350122 8259 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260924 17:33:02.350154 8259 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:33:02.350185 8259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:02.351820 8259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:44215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:02.352126 8259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:02.352375 8259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:02.358016 8266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.358184 8259 server_base.cc:1034] running on GCE node
W20260924 17:33:02.358034 8268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:02.358114 8265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.358495 8259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:02.358711 8259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:02.359861 8259 hybrid_clock.cc:648] HybridClock initialized: now 1790271182359847 us; error 28 us; skew 500 ppm
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:02.362443 8259 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:33:02.362983 8259 webserver.cc:460] Webserver started at http://127.6.37.2:36383/ using document root <none> and password file <none>
I20260924 17:33:02.363240 8259 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:02.363306 8259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:02.363474 8259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:02.364647 8259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "b80d447219cd4dadaa47e956a361707c"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "4ae54bf580def6c8c10b07ef9cfefcd0"
server_key_iv: "7c2e11ead44f5b2fc337accb4733833f"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.365082 8259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "b80d447219cd4dadaa47e956a361707c"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "4ae54bf580def6c8c10b07ef9cfefcd0"
server_key_iv: "7c2e11ead44f5b2fc337accb4733833f"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.366550 8259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:02.367412 8275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.367636 8259 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260924 17:33:02.367735 8259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "b80d447219cd4dadaa47e956a361707c"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "4ae54bf580def6c8c10b07ef9cfefcd0"
server_key_iv: "7c2e11ead44f5b2fc337accb4733833f"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.367812 8259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:02.387511 8259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:02.389689 8259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:02.389851 8259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:02.390475 8259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:02.390543 8259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.390581 8259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:02.390614 8259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:02.398904 8259 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:37583
I20260924 17:33:02.399012 8392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:37583 every 8 connection(s)
I20260924 17:33:02.399464 8259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:02.401541 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.390920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:47847 (local address 127.6.37.62:44215)
0924 17:33:02.390976 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.390979 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.391216 (+ 237us) server_negotiation.cc:407] Connection header received
0924 17:33:02.392007 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.392009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.392021 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.392067 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.393052 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.393669 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.395536 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.395758 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.395859 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.398370 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.398372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.398372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.398380 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.400128 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.400514 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.400515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.400515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.400571 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.400765 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.400766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.400766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.400876 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.400960 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.401402 (+ 442us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.401471 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260924 17:33:02.401803 8284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.390855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.6.37.2:47847)
0924 17:33:02.391054 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.391105 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.391872 (+ 767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.392152 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.392157 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.392585 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.392943 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.392951 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.393768 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.393770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.395441 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.395445 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.395879 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.395880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.396064 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.396669 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.396683 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.398279 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.400201 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.400205 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.400206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.400440 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.400624 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.400624 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.400624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.400706 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.401112 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.401119 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.401244 (+ 125us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.401382 (+ 138us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.401517 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260924 17:33:02.402340 8393 heartbeater.cc:347] Connected to a master server at 127.6.37.62:44215
I20260924 17:33:02.402472 8393 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:02.402846 8393 heartbeater.cc:511] Master 127.6.37.62:44215 requested a full tablet report, sending...
I20260924 17:33:02.403319 8045 ts_manager.cc:194] Registered new tserver with Master: b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583)
I20260924 17:33:02.403841 8045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:47847
I20260924 17:33:02.408391 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8259
I20260924 17:33:02.408492 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:02.408691 6292 external_mini_cluster.cc:1428] Setting key 60cf61dfaaf4dce2eb212dc5b6d4d6fa
I20260924 17:33:02.409763 8399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.403438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.6.37.2:41243)
0924 17:33:02.403580 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.403591 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.403658 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.403785 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.403786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.403982 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.404062 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.404064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.404806 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.404807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.405340 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.405342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.405703 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.405704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.405821 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.406445 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.406450 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.406769 (+ 319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.408264 (+ 1495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.408265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.408266 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.408528 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.408749 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.408750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.408751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.408827 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.409439 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.409440 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.409493 (+ 53us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.409593 (+ 100us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.409688 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
I20260924 17:33:02.409829 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.403489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41243 (local address 127.6.37.62:44215)
0924 17:33:02.403551 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.403553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.403650 (+ 97us) server_negotiation.cc:407] Connection header received
0924 17:33:02.403702 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.403703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.403713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.403778 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.404138 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.404644 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.405430 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.405608 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.405668 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.406935 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.406937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.406938 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.406945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.408157 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.408614 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.408615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.408615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.408674 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.408912 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.408912 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.408913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.409123 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.409412 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.409641 (+ 229us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.409730 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:33:02.434192 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44215
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:02.518743 8402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:02.519042 8402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:02.519088 8402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:02.520231 8402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:02.520304 8402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:02.520344 8402 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260924 17:33:02.520370 8402 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:33:02.520407 8402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:02.521864 8402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:44215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:02.522128 8402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:02.522367 8402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:02.527566 8410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:02.527606 8408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.527714 8402 server_base.cc:1034] running on GCE node
W20260924 17:33:02.527627 8407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:02.527967 8402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:02.528182 8402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:02.529384 8402 hybrid_clock.cc:648] HybridClock initialized: now 1790271182529369 us; error 27 us; skew 500 ppm
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:02.531997 8402 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:33:02.532434 8402 webserver.cc:460] Webserver started at http://127.6.37.3:36961/ using document root <none> and password file <none>
I20260924 17:33:02.532651 8402 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:02.532697 8402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:02.532841 8402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:02.533864 8402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "d8e1657cdf154bc18d2995b5002dfc9b"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "425159c90bd7bed846b90bd9200d120b"
server_key_iv: "a22257b9ee3770f65e95e18836a240ca"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.534284 8402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "d8e1657cdf154bc18d2995b5002dfc9b"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "425159c90bd7bed846b90bd9200d120b"
server_key_iv: "a22257b9ee3770f65e95e18836a240ca"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.535939 8402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:02.536748 8417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.536932 8402 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.537060 8402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "d8e1657cdf154bc18d2995b5002dfc9b"
format_stamp: "Formatted at 2026-09-24 17:33:02 on dist-test-slave-gcz9"
server_key: "425159c90bd7bed846b90bd9200d120b"
server_key_iv: "a22257b9ee3770f65e95e18836a240ca"
server_key_version: "encryptionkey@0"
I20260924 17:33:02.537128 8402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:02.554210 8402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:02.556677 8402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:02.556846 8402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:02.557422 8402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:02.557484 8402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:02.557564 8402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:02.557598 8402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:02.565105 8402 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:43377
I20260924 17:33:02.565508 8402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:02.565958 8533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:43377 every 8 connection(s)
I20260924 17:33:02.567574 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.557790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:58513 (local address 127.6.37.62:44215)
0924 17:33:02.557846 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.557848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.558159 (+ 311us) server_negotiation.cc:407] Connection header received
0924 17:33:02.558751 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.558753 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.558768 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.558859 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.559751 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.560597 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.561738 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.562085 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.562165 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.564696 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.564698 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.564698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.564706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.566312 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.566662 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.566662 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.566663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.566712 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.566930 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.566930 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.566931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.567041 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.567095 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.567448 (+ 353us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.567511 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:02.567775 8426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.557802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.6.37.3:58513)
0924 17:33:02.557996 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.558061 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.558651 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.558995 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.559016 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.559312 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.559623 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.559650 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.560722 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.560723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.561630 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.561633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.562187 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.562188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.562316 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.562922 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.562934 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.564596 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.566389 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.566393 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.566395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.566594 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.566753 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.566753 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.566753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.566836 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.567111 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.567119 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.567311 (+ 192us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.567418 (+ 107us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.567537 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260924 17:33:02.568306 8534 heartbeater.cc:347] Connected to a master server at 127.6.37.62:44215
I20260924 17:33:02.568435 8534 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:02.568624 8534 heartbeater.cc:511] Master 127.6.37.62:44215 requested a full tablet report, sending...
I20260924 17:33:02.569084 8044 ts_manager.cc:194] Registered new tserver with Master: d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:02.569612 8044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:58513
I20260924 17:33:02.573797 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8402
I20260924 17:33:02.573884 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:02.574076 6292 external_mini_cluster.cc:1428] Setting key 687b73e321fd94f26c9321f30a273821
I20260924 17:33:02.574965 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.569371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:45853 (local address 127.6.37.62:44215)
0924 17:33:02.569417 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.569419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.569518 (+ 99us) server_negotiation.cc:407] Connection header received
0924 17:33:02.569591 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.569592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.569600 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.569646 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.569999 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.570620 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.571385 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.571565 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.571636 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.572452 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.572453 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.572453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.572467 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.573657 (+ 1190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.574053 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.574054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.574054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.574107 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.574352 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.574353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.574353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.574488 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.574568 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.574775 (+ 207us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.574850 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:33:02.574988 8541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.569266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.6.37.3:45853)
0924 17:33:02.569444 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.569455 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.569519 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.569652 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.569652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.569841 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.569920 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.569922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.570721 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.570722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.571291 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.571293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.571657 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.571658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.571766 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.572114 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.572118 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.572369 (+ 251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.573743 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.573743 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.573744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.573968 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.574199 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.574200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.574200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.574272 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.574582 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.574583 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.574632 (+ 49us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.574738 (+ 106us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.574833 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":115,"threads_started":1}
I20260924 17:33:02.575074 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:02.597726 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.591014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.6.37.62:44215)
0924 17:33:02.591078 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.591080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.591106 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:33:02.591181 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.591182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.591192 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.591242 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.591789 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.592264 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.592990 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.593164 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.593213 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.595521 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.595522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.595522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.595528 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.596754 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.597109 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.597110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.597110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.597155 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.597319 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.597319 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.597320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.597414 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.597485 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.597573 (+ 88us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.597630 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:33:02.599821 8044 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:02.601402 8044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:02.608491 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.604247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44692 (local address 127.6.37.2:37583)
0924 17:33:02.604576 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.604581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.604590 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:02.604626 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.604628 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.604643 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.604721 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.604915 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.605972 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.607279 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.608026 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.608098 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.608162 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.608353 (+ 191us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.608396 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":90,"threads_started":1}
I20260924 17:33:02.608498 8553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.603937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37583 (local address 127.0.0.1:44692)
0924 17:33:02.604098 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.604138 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.604203 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.604793 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.604794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.604796 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.604838 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.604840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.606054 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.606055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.607191 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.607194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.608121 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.608122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.608226 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.608243 (+ 17us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.608327 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.608392 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":122,"thread_start_us":50,"threads_started":1}
I20260924 17:33:02.608763 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.604372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44296 (local address 127.6.37.1:43523)
0924 17:33:02.604758 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.604763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.604790 (+ 27us) server_negotiation.cc:407] Connection header received
0924 17:33:02.604835 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.604837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.604855 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.604938 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.605131 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.605858 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.607443 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.608127 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.608195 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.608243 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.608626 (+ 383us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.608667 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":94,"threads_started":1}
I20260924 17:33:02.609321 8552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.603950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:43377 (local address 127.0.0.1:47654)
0924 17:33:02.604098 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.604138 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.604204 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.604584 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.604588 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.604590 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.604659 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.604661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.606035 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.606035 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.607349 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.607351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.609122 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.609124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.609199 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.609203 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.609238 (+ 35us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.609267 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":30,"thread_start_us":97,"threads_started":1}
I20260924 17:33:02.609428 8325 tablet_service.cc:1467] Processing CreateTablet for tablet 61840ba8df974946bf52f35351cc711a (DEFAULT_TABLE table=test-table [id=c45ec000672c4e1eb0c1534b751bde85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:02.609743 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.604023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47654 (local address 127.6.37.3:43377)
0924 17:33:02.604372 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.604378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.604389 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:33:02.604431 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.604432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.604449 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.604572 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.604751 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.605908 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.608278 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.609032 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.609452 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.609540 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.609566 (+ 26us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.609615 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":100,"threads_started":1}
I20260924 17:33:02.609889 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61840ba8df974946bf52f35351cc711a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.610319 8468 tablet_service.cc:1467] Processing CreateTablet for tablet 61840ba8df974946bf52f35351cc711a (DEFAULT_TABLE table=test-table [id=c45ec000672c4e1eb0c1534b751bde85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:02.610617 8468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61840ba8df974946bf52f35351cc711a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.608498 8555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.604161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.0.0.1:44296)
0924 17:33:02.604389 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.604400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.604448 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.604935 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.604936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.604938 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.604988 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.604990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.605970 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.605971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.607348 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.607351 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.608204 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.608205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.608256 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.608259 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.608327 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.608392 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":107,"thread_start_us":64,"threads_started":1}
I20260924 17:33:02.611708 8183 tablet_service.cc:1467] Processing CreateTablet for tablet 61840ba8df974946bf52f35351cc711a (DEFAULT_TABLE table=test-table [id=c45ec000672c4e1eb0c1534b751bde85]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:02.612076 8183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61840ba8df974946bf52f35351cc711a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.613318 8558 tablet_bootstrap.cc:492] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Bootstrap starting.
I20260924 17:33:02.613898 8559 tablet_bootstrap.cc:492] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Bootstrap starting.
I20260924 17:33:02.614413 8558 tablet_bootstrap.cc:654] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.614501 8559 tablet_bootstrap.cc:654] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.614748 8558 log.cc:824] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:02.614823 8559 log.cc:824] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:02.615715 8559 tablet_bootstrap.cc:492] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: No bootstrap required, opened a new log
I20260924 17:33:02.615758 8562 tablet_bootstrap.cc:492] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Bootstrap starting.
I20260924 17:33:02.615790 8559 ts_tablet_manager.cc:1397] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:02.616355 8562 tablet_bootstrap.cc:654] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.616673 8562 log.cc:824] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:02.617426 8562 tablet_bootstrap.cc:492] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: No bootstrap required, opened a new log
I20260924 17:33:02.617492 8562 ts_tablet_manager.cc:1397] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:02.617934 8559 raft_consensus.cc:348] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.618096 8559 raft_consensus.cc:374] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.618130 8559 raft_consensus.cc:729] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80d447219cd4dadaa47e956a361707c, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.618244 8559 consensus_queue.cc:260] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.618511 8559 ts_tablet_manager.cc:1428] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:33:02.618780 8558 tablet_bootstrap.cc:492] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: No bootstrap required, opened a new log
I20260924 17:33:02.618847 8558 ts_tablet_manager.cc:1397] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260924 17:33:02.619436 8562 raft_consensus.cc:348] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.619581 8562 raft_consensus.cc:374] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.619616 8562 raft_consensus.cc:729] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.619742 8562 consensus_queue.cc:260] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.619995 8562 ts_tablet_manager.cc:1428] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 17:33:02.620048 8250 heartbeater.cc:503] Master 127.6.37.62:44215 was elected leader, sending a full tablet report...
I20260924 17:33:02.620774 8558 raft_consensus.cc:348] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.620929 8558 raft_consensus.cc:374] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.620954 8558 raft_consensus.cc:729] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.621093 8558 consensus_queue.cc:260] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.621357 8558 ts_tablet_manager.cc:1428] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:33:02.621392 8534 heartbeater.cc:503] Master 127.6.37.62:44215 was elected leader, sending a full tablet report...
I20260924 17:33:02.621512 8393 heartbeater.cc:503] Master 127.6.37.62:44215 was elected leader, sending a full tablet report...
W20260924 17:33:02.650079 8394 tablet.cc:2369] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:33:02.732963 8251 tablet.cc:2369] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:33:02.816179 8535 tablet.cc:2369] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:33:02.865345 8566 raft_consensus.cc:482] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:02.865471 8566 raft_consensus.cc:504] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.865916 8566 leader_election.cc:288] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583), 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523)
I20260924 17:33:02.869061 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.866228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:50471 (local address 127.6.37.1:43523)
0924 17:33:02.866276 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.866278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.866290 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:33:02.866324 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.866325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.866338 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.866406 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.866600 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.867195 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.868204 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.868707 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.868780 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.868793 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.868932 (+ 139us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.868977 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:02.869056 8426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.866103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.6.37.3:50471)
0924 17:33:02.866168 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.866181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.866237 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.866428 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.866429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.866431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.866514 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.866516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.867271 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.867272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.868113 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.868115 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.868784 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.868785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.868863 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.868867 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.868908 (+ 41us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.868938 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260924 17:33:02.869081 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.866242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:35645 (local address 127.6.37.2:37583)
0924 17:33:02.866288 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.866290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.866409 (+ 119us) server_negotiation.cc:407] Connection header received
0924 17:33:02.866445 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.866446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.866460 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.866532 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.866728 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.867258 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.868269 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.868710 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.868793 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.868802 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.868982 (+ 180us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.869016 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:02.869136 8567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.866129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37583 (local address 127.6.37.3:35645)
0924 17:33:02.866321 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.866331 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.866395 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.866576 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.866577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.866579 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.866651 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.866652 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.867363 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.867364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.868179 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.868183 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.868805 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.868806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.868886 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.868889 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.868964 (+ 75us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.869001 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260924 17:33:02.869463 8203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61840ba8df974946bf52f35351cc711a" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" is_pre_election: true
I20260924 17:33:02.869513 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61840ba8df974946bf52f35351cc711a" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c" is_pre_election: true
I20260924 17:33:02.869659 8203 raft_consensus.cc:2454] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 0.
I20260924 17:33:02.869675 8345 raft_consensus.cc:2454] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 0.
I20260924 17:33:02.869899 8418 leader_election.cc:302] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fab16ca0ba547dda4b270ce2c88ea9f, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:02.870045 8566 raft_consensus.cc:2781] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:02.870100 8566 raft_consensus.cc:482] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:02.870146 8566 raft_consensus.cc:3037] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:02.871212 8566 raft_consensus.cc:504] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.871359 8566 leader_election.cc:288] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 election: Requested vote from peers b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583), 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523)
I20260924 17:33:02.871507 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61840ba8df974946bf52f35351cc711a" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c"
I20260924 17:33:02.871589 8345 raft_consensus.cc:3037] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:02.872299 8345 raft_consensus.cc:2454] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 1.
I20260924 17:33:02.872421 8203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61840ba8df974946bf52f35351cc711a" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f"
I20260924 17:33:02.872476 8420 leader_election.cc:302] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b80d447219cd4dadaa47e956a361707c, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:02.872536 8203 raft_consensus.cc:3037] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:02.872576 8566 raft_consensus.cc:2781] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:02.872713 8566 raft_consensus.cc:686] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 1 LEADER]: Becoming Leader. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Running, Role: LEADER
I20260924 17:33:02.872951 8566 consensus_queue.cc:237] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } }
I20260924 17:33:02.873373 8203 raft_consensus.cc:2454] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 1.
I20260924 17:33:02.873885 8045 catalog_manager.cc:5495] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b reported cstate change: term changed from 0 to 1, leader changed from <none> to d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3). New cstate: current_term: 1 leader_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } health_report { overall_health: UNKNOWN } } }
Sep 24 17:33:02 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271182, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:02.910653 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.903505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44215 (local address 127.0.0.1:57662)
0924 17:33:02.903695 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.903705 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.903765 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.903885 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.903885 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.904220 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:02.904268 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.904270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.904884 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.904885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.905409 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.905411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.905731 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.905732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.905773 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.906327 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:02.906332 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:02.908125 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:02.909684 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.909691 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.909693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.909883 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.910085 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:02.910086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:02.910086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:02.910155 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:02.910385 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:02.910391 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:02.910433 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.910485 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.910580 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":108,"threads_started":1}
I20260924 17:33:02.910720 8095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.903566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57662 (local address 127.6.37.62:44215)
0924 17:33:02.903638 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.903641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.903769 (+ 128us) server_negotiation.cc:407] Connection header received
0924 17:33:02.903816 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.903817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.903826 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.903865 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:02.904334 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.904818 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.905480 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.905666 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.905715 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.908229 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:02.908231 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:02.908231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:02.908237 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:02.909604 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.909957 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.909958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.909959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.910015 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:02.910217 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:02.910218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:02.910218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:02.910326 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:02.910382 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.910521 (+ 139us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.910634 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":41}
I20260924 17:33:02.912803 8045 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:57662:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260924 17:33:02.913024 8045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:02.914485 8325 tablet_service.cc:1467] Processing CreateTablet for tablet 4e581155a19e4c8d86cd77e990bc0ac0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=080a341673ff458ba300d2ab875a1acb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:02.914575 8468 tablet_service.cc:1467] Processing CreateTablet for tablet 4e581155a19e4c8d86cd77e990bc0ac0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=080a341673ff458ba300d2ab875a1acb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:02.914582 8183 tablet_service.cc:1467] Processing CreateTablet for tablet 4e581155a19e4c8d86cd77e990bc0ac0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=080a341673ff458ba300d2ab875a1acb]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:02.914655 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e581155a19e4c8d86cd77e990bc0ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.914700 8468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e581155a19e4c8d86cd77e990bc0ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.914734 8183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4e581155a19e4c8d86cd77e990bc0ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:02.915917 8558 tablet_bootstrap.cc:492] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: Bootstrap starting.
I20260924 17:33:02.916213 8562 tablet_bootstrap.cc:492] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Bootstrap starting.
I20260924 17:33:02.916217 8559 tablet_bootstrap.cc:492] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: Bootstrap starting.
I20260924 17:33:02.916349 8558 tablet_bootstrap.cc:654] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.916601 8559 tablet_bootstrap.cc:654] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.916617 8562 tablet_bootstrap.cc:654] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:02.917251 8559 tablet_bootstrap.cc:492] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: No bootstrap required, opened a new log
I20260924 17:33:02.917320 8559 ts_tablet_manager.cc:1397] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:02.917361 8562 tablet_bootstrap.cc:492] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: No bootstrap required, opened a new log
I20260924 17:33:02.917419 8562 ts_tablet_manager.cc:1397] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:02.917521 8558 tablet_bootstrap.cc:492] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: No bootstrap required, opened a new log
I20260924 17:33:02.917479 8559 raft_consensus.cc:348] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.917577 8558 ts_tablet_manager.cc:1397] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:02.917584 8559 raft_consensus.cc:374] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.917618 8559 raft_consensus.cc:729] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80d447219cd4dadaa47e956a361707c, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.917604 8562 raft_consensus.cc:348] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.917680 8562 raft_consensus.cc:374] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.917663 8559 consensus_queue.cc:260] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.917701 8562 raft_consensus.cc:729] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.917744 8562 consensus_queue.cc:260] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.917775 8559 ts_tablet_manager.cc:1428] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:02.917722 8558 raft_consensus.cc:348] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.917802 8558 raft_consensus.cc:374] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:02.917840 8558 raft_consensus.cc:729] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Initialized, Role: FOLLOWER
I20260924 17:33:02.917850 8562 ts_tablet_manager.cc:1428] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:02.917807 8564 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:02.917886 8564 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:02.917886 8558 consensus_queue.cc:260] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.917981 8558 ts_tablet_manager.cc:1428] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:02.917991 8565 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:02.918061 8565 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:02.918171 8566 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:02.918237 8566 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:02.994285 8565 raft_consensus.cc:482] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:02.994381 8565 raft_consensus.cc:504] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:02.994782 8565 leader_election.cc:288] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583), d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:02.998901 8556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.995137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:45349 (local address 127.6.37.2:37583)
0924 17:33:02.995198 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.995200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.995370 (+ 170us) server_negotiation.cc:407] Connection header received
0924 17:33:02.995401 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.995402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.995412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.995461 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.995646 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.996394 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.998106 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.998461 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.998576 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.998587 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.998757 (+ 170us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.998802 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:02.998946 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.995025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37583 (local address 127.6.37.1:45349)
0924 17:33:02.995233 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.995243 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.995326 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.995475 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.995476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.995477 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.995562 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.995564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.996490 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.996491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.998007 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.998011 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.998630 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.998631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.998680 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.998685 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.998727 (+ 42us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.998764 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":25,"thread_start_us":78,"threads_started":1}
I20260924 17:33:02.999173 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e581155a19e4c8d86cd77e990bc0ac0" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c" is_pre_election: true
I20260924 17:33:02.999274 8345 raft_consensus.cc:2454] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 0.
I20260924 17:33:02.999493 8135 leader_election.cc:302] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fab16ca0ba547dda4b270ce2c88ea9f, b80d447219cd4dadaa47e956a361707c; no voters:
I20260924 17:33:02.999567 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.995087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:33089 (local address 127.6.37.3:43377)
0924 17:33:02.995134 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:02.995137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:02.995249 (+ 112us) server_negotiation.cc:407] Connection header received
0924 17:33:02.995363 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:02.995364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:02.995378 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:02.995441 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:02.995646 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.996400 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.998561 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.999182 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.999284 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.999294 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:02.999460 (+ 166us) server_negotiation.cc:299] Negotiation successful
0924 17:33:02.999499 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:02.999588 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:02.995025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:43377 (local address 127.6.37.1:33089)
0924 17:33:02.995167 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:02.995179 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:02.995248 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:02.995473 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:02.995474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:02.995476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:02.995563 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.995564 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.996490 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.996491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.998461 (+ 1970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:02.998464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:02.999290 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:02.999291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:02.999370 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:02.999374 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:02.999450 (+ 76us) client_negotiation.cc:240] Negotiation successful
0924 17:33:02.999493 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":54,"thread_start_us":82,"threads_started":1}
I20260924 17:33:02.999859 8565 raft_consensus.cc:2781] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:02.999915 8565 raft_consensus.cc:482] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:02.999939 8565 raft_consensus.cc:3037] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:02.999941 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e581155a19e4c8d86cd77e990bc0ac0" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" is_pre_election: true
I20260924 17:33:03.000058 8488 raft_consensus.cc:2454] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 0.
I20260924 17:33:03.000706 8565 raft_consensus.cc:504] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.000855 8565 leader_election.cc:288] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 election: Requested vote from peers b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583), d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:03.000988 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e581155a19e4c8d86cd77e990bc0ac0" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c"
I20260924 17:33:03.001065 8345 raft_consensus.cc:3037] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:03.001030 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e581155a19e4c8d86cd77e990bc0ac0" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8e1657cdf154bc18d2995b5002dfc9b"
I20260924 17:33:03.001111 8488 raft_consensus.cc:3037] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:03.001669 8345 raft_consensus.cc:2454] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 1.
I20260924 17:33:03.001830 8488 raft_consensus.cc:2454] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 1.
I20260924 17:33:03.002027 8135 leader_election.cc:302] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fab16ca0ba547dda4b270ce2c88ea9f, b80d447219cd4dadaa47e956a361707c; no voters:
I20260924 17:33:03.002130 8565 raft_consensus.cc:2781] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:03.002254 8565 raft_consensus.cc:686] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 LEADER]: Becoming Leader. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Running, Role: LEADER
I20260924 17:33:03.002357 8565 consensus_queue.cc:237] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.002832 8582 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: TxnStatusTablet state changed. Reason: New leader 0fab16ca0ba547dda4b270ce2c88ea9f. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.002982 8582 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:03.003226 8584 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260924 17:33:03.003345 8584 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260924 17:33:03.003283 8045 catalog_manager.cc:5495] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1). New cstate: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:03.012596 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.009700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44302 (local address 127.6.37.1:43523)
0924 17:33:03.009767 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:03.009769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:03.009868 (+ 99us) server_negotiation.cc:407] Connection header received
0924 17:33:03.009960 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:03.009961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:03.009976 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:03.010031 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:03.010152 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.010626 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.011745 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.011958 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.012028 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.012245 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.012361 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.012432 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:03.012512 (+ 80us) server_negotiation.cc:299] Negotiation successful
0924 17:33:03.012533 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260924 17:33:03.012633 8575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.009632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.0.0.1:44302)
0924 17:33:03.009800 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:03.009815 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:03.009879 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:03.010038 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:03.010038 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:03.010040 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:03.010090 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.010093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.010711 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.010712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.011647 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.011651 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.012055 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.012056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.012125 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.012143 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.012439 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.012448 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 17:33:03.012508 (+ 60us) client_negotiation.cc:240] Negotiation successful
0924 17:33:03.012556 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260924 17:33:03.014779 8345 raft_consensus.cc:1261] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Refusing update from remote peer 0fab16ca0ba547dda4b270ce2c88ea9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:03.014782 8488 raft_consensus.cc:1261] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Refusing update from remote peer 0fab16ca0ba547dda4b270ce2c88ea9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:03.015183 8582 consensus_queue.cc:1035] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:03.015337 8565 consensus_queue.cc:1035] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:03.016577 8564 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: TxnStatusTablet state changed. Reason: New leader 0fab16ca0ba547dda4b270ce2c88ea9f. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.016667 8564 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:03.016721 8566 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: TxnStatusTablet state changed. Reason: New leader 0fab16ca0ba547dda4b270ce2c88ea9f. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.016789 8566 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:03.018049 8565 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.018131 8565 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:03.018290 8582 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.018267 8564 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.018354 8582 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P 0fab16ca0ba547dda4b270ce2c88ea9f: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:03.018364 8564 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P b80d447219cd4dadaa47e956a361707c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:03.018702 8589 mvcc.cc:205] Tried to move back new op lower bound from 7332950765625630720 to 7332950765578174464. Current Snapshot: MvccSnapshot[applied={T|T < 7332950765625630720}]
I20260924 17:33:03.018775 8566 tablet_replica.cc:439] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } } }
I20260924 17:33:03.018853 8566 tablet_replica.cc:442] T 4e581155a19e4c8d86cd77e990bc0ac0 P d8e1657cdf154bc18d2995b5002dfc9b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:03.019779 8588 mvcc.cc:205] Tried to move back new op lower bound from 7332950765625630720 to 7332950765578174464. Current Snapshot: MvccSnapshot[applied={T|T < 7332950765625630720}]
I20260924 17:33:03.022773 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.020386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47670 (local address 127.6.37.3:43377)
0924 17:33:03.020429 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:03.020431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:03.020440 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:03.020487 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:03.020488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:03.020504 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:03.020561 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:03.020725 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.021192 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.021986 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.022193 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.022266 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.022456 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.022555 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.022648 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:03.022674 (+ 26us) server_negotiation.cc:299] Negotiation successful
0924 17:33:03.022698 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:03.027496 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.025243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:50773 (local address 127.6.37.1:43523)
0924 17:33:03.025316 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:03.025318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:03.025329 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:33:03.025351 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:03.025352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:03.025361 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:03.025424 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:03.025546 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.026002 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.026728 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.027003 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.027086 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.027272 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.027304 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.027358 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:03.027414 (+ 56us) server_negotiation.cc:299] Negotiation successful
0924 17:33:03.027432 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260924 17:33:03.027515 8541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.025163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.6.37.3:50773)
0924 17:33:03.025238 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:03.025250 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:03.025297 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:03.025425 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:03.025425 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:03.025426 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:03.025473 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.025475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.026090 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.026091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.026639 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.026641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.027089 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.027090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.027157 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.027170 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.027365 (+ 195us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.027366 (+ 1us) client_negotiation.cc:769] Sending connection context
0924 17:33:03.027412 (+ 46us) client_negotiation.cc:240] Negotiation successful
0924 17:33:03.027448 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260924 17:33:03.029881 8345 raft_consensus.cc:1261] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Refusing update from remote peer d8e1657cdf154bc18d2995b5002dfc9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:03.029904 8203 raft_consensus.cc:1261] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Refusing update from remote peer d8e1657cdf154bc18d2995b5002dfc9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:03.030133 8568 consensus_queue.cc:1035] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:03.030232 8566 consensus_queue.cc:1035] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:03.032083 8587 mvcc.cc:205] Tried to move back new op lower bound from 7332950765688180736 to 7332950765048348672. Current Snapshot: MvccSnapshot[applied={T|T < 7332950765688180736}]
I20260924 17:33:03.045884 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.036631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:51021 (local address 127.6.37.3:43377)
0924 17:33:03.036733 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:03.036735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:03.043119 (+ 6384us) server_negotiation.cc:407] Connection header received
0924 17:33:03.043193 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:03.043194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:03.043208 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:03.043258 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:03.043406 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.043980 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.045223 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.045438 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.045497 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.045693 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.045720 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.045759 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:03.045811 (+ 52us) server_negotiation.cc:299] Negotiation successful
0924 17:33:03.045829 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260924 17:33:03.045949 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.036597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:43377 (local address 127.6.37.1:51021)
0924 17:33:03.043034 (+ 6437us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:03.043045 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:03.043132 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:03.043259 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:03.043260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:03.043261 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:03.043331 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.043333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.044115 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.044116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.045141 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.045144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.045520 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.045521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.045593 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.045610 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.045760 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.045762 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:33:03.045810 (+ 48us) client_negotiation.cc:240] Negotiation successful
0924 17:33:03.045851 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6385,"thread_start_us":108,"threads_started":1}
I20260924 17:33:03.058089 8045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:03.058204 8045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:03.058970 8045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Sending DeleteTablet for 3 replicas of tablet 61840ba8df974946bf52f35351cc711a
I20260924 17:33:03.059351 8468 tablet_service.cc:1514] Processing DeleteTablet for tablet 61840ba8df974946bf52f35351cc711a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:03 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:47654
I20260924 17:33:03.059365 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet 61840ba8df974946bf52f35351cc711a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:03 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44692
I20260924 17:33:03.059607 8183 tablet_service.cc:1514] Processing DeleteTablet for tablet 61840ba8df974946bf52f35351cc711a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:03 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44296
I20260924 17:33:03.059736 8608 tablet_replica.cc:330] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: stopping tablet replica
I20260924 17:33:03.059926 8608 raft_consensus.cc:2229] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:03.060038 8608 raft_consensus.cc:2258] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:03.060055 8045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:03.060194 8045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:03.060700 8608 ts_tablet_manager.cc:1905] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:03.061195 8325 tablet_service.cc:1467] Processing CreateTablet for tablet 0a660199364b43fd9905e4e749bbbe95 (DEFAULT_TABLE table=test-table [id=3fb37cf294bd493c848dc6be981e6f98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:03.061321 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a660199364b43fd9905e4e749bbbe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:03.062669 8559 tablet_bootstrap.cc:492] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Bootstrap starting.
I20260924 17:33:03.063155 8559 tablet_bootstrap.cc:654] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:03.063369 8608 ts_tablet_manager.cc:1918] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:03.063504 8608 log.cc:1196] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/61840ba8df974946bf52f35351cc711a
I20260924 17:33:03.063719 8468 tablet_service.cc:1467] Processing CreateTablet for tablet 0a660199364b43fd9905e4e749bbbe95 (DEFAULT_TABLE table=test-table [id=3fb37cf294bd493c848dc6be981e6f98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:03.063836 8468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a660199364b43fd9905e4e749bbbe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:03.063943 8608 ts_tablet_manager.cc:1939] T 61840ba8df974946bf52f35351cc711a P b80d447219cd4dadaa47e956a361707c: Deleting consensus metadata
I20260924 17:33:03.064376 8031 catalog_manager.cc:4841] TS b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583): tablet 61840ba8df974946bf52f35351cc711a (table test-table [id=c45ec000672c4e1eb0c1534b751bde85]) successfully deleted
I20260924 17:33:03.064599 8609 tablet_replica.cc:330] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: stopping tablet replica
I20260924 17:33:03.064747 8607 tablet_replica.cc:330] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: stopping tablet replica
I20260924 17:33:03.064880 8607 raft_consensus.cc:2229] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:03.065021 8609 raft_consensus.cc:2229] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:03.065065 8558 tablet_bootstrap.cc:492] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Bootstrap starting.
I20260924 17:33:03.065299 8609 raft_consensus.cc:2258] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:03.065584 8558 tablet_bootstrap.cc:654] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:03.066035 8183 tablet_service.cc:1467] Processing CreateTablet for tablet 0a660199364b43fd9905e4e749bbbe95 (DEFAULT_TABLE table=test-table [id=3fb37cf294bd493c848dc6be981e6f98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:03.066143 8183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a660199364b43fd9905e4e749bbbe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:03.066394 8609 ts_tablet_manager.cc:1905] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:03.067457 8562 tablet_bootstrap.cc:492] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Bootstrap starting.
I20260924 17:33:03.067891 8562 tablet_bootstrap.cc:654] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:03.068415 8609 ts_tablet_manager.cc:1918] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:03.068531 8609 log.cc:1196] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/61840ba8df974946bf52f35351cc711a
I20260924 17:33:03.065183 8607 raft_consensus.cc:2258] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:03.068971 8562 tablet_bootstrap.cc:492] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: No bootstrap required, opened a new log
I20260924 17:33:03.069032 8562 ts_tablet_manager.cc:1397] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:03.069195 8562 raft_consensus.cc:348] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.069283 8562 raft_consensus.cc:374] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:03.069308 8562 raft_consensus.cc:729] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Initialized, Role: FOLLOWER
I20260924 17:33:03.069346 8562 consensus_queue.cc:260] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.069427 8562 ts_tablet_manager.cc:1428] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:03.069608 8607 ts_tablet_manager.cc:1905] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:03.070516 8559 tablet_bootstrap.cc:492] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: No bootstrap required, opened a new log
I20260924 17:33:03.070576 8559 ts_tablet_manager.cc:1397] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260924 17:33:03.070708 8559 raft_consensus.cc:348] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.070780 8559 raft_consensus.cc:374] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:03.070807 8559 raft_consensus.cc:729] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80d447219cd4dadaa47e956a361707c, State: Initialized, Role: FOLLOWER
I20260924 17:33:03.070845 8559 consensus_queue.cc:260] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.071015 8559 ts_tablet_manager.cc:1428] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:03.071595 8607 ts_tablet_manager.cc:1918] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:03.071707 8607 log.cc:1196] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/61840ba8df974946bf52f35351cc711a
I20260924 17:33:03.071969 8607 ts_tablet_manager.cc:1939] T 61840ba8df974946bf52f35351cc711a P d8e1657cdf154bc18d2995b5002dfc9b: Deleting consensus metadata
I20260924 17:33:03.072472 8029 catalog_manager.cc:4841] TS d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377): tablet 61840ba8df974946bf52f35351cc711a (table test-table [id=c45ec000672c4e1eb0c1534b751bde85]) successfully deleted
I20260924 17:33:03.072561 8609 ts_tablet_manager.cc:1939] T 61840ba8df974946bf52f35351cc711a P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting consensus metadata
I20260924 17:33:03.072959 8029 catalog_manager.cc:4841] TS 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523): tablet 61840ba8df974946bf52f35351cc711a (table test-table [id=c45ec000672c4e1eb0c1534b751bde85]) successfully deleted
I20260924 17:33:03.073058 8558 tablet_bootstrap.cc:492] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: No bootstrap required, opened a new log
I20260924 17:33:03.073109 8558 ts_tablet_manager.cc:1397] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260924 17:33:03.073242 8558 raft_consensus.cc:348] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.073309 8558 raft_consensus.cc:374] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:03.073329 8558 raft_consensus.cc:729] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Initialized, Role: FOLLOWER
I20260924 17:33:03.073385 8558 consensus_queue.cc:260] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.073467 8558 ts_tablet_manager.cc:1428] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:03.080752 8598 raft_consensus.cc:482] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:03.080838 8598 raft_consensus.cc:504] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.080977 8598 leader_election.cc:288] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583), d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:03.081187 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a660199364b43fd9905e4e749bbbe95" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" is_pre_election: true
I20260924 17:33:03.081262 8488 raft_consensus.cc:2454] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 0.
I20260924 17:33:03.081248 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a660199364b43fd9905e4e749bbbe95" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c" is_pre_election: true
I20260924 17:33:03.081322 8345 raft_consensus.cc:2454] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 0.
I20260924 17:33:03.081393 8133 leader_election.cc:302] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fab16ca0ba547dda4b270ce2c88ea9f, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:03.081466 8598 raft_consensus.cc:2781] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:03.081491 8598 raft_consensus.cc:482] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:03.081511 8598 raft_consensus.cc:3037] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:03.082231 8598 raft_consensus.cc:504] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.082360 8598 leader_election.cc:288] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 election: Requested vote from peers b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583), d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:03.082551 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a660199364b43fd9905e4e749bbbe95" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8e1657cdf154bc18d2995b5002dfc9b"
I20260924 17:33:03.082566 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a660199364b43fd9905e4e749bbbe95" candidate_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c"
I20260924 17:33:03.082617 8488 raft_consensus.cc:3037] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:03.082630 8345 raft_consensus.cc:3037] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:03.083398 8488 raft_consensus.cc:2454] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 1.
I20260924 17:33:03.083434 8345 raft_consensus.cc:2454] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0fab16ca0ba547dda4b270ce2c88ea9f in term 1.
I20260924 17:33:03.083546 8133 leader_election.cc:302] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fab16ca0ba547dda4b270ce2c88ea9f, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:03.083631 8598 raft_consensus.cc:2781] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:03.083674 8598 raft_consensus.cc:686] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 LEADER]: Becoming Leader. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Running, Role: LEADER
I20260924 17:33:03.083710 8598 consensus_queue.cc:237] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:03.084234 8045 catalog_manager.cc:5495] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1). New cstate: current_term: 1 leader_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:03.091450 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.088305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44316 (local address 127.6.37.1:43523)
0924 17:33:03.088456 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:03.088458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:03.088465 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:33:03.088488 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:03.088489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:03.088498 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:03.088564 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:03.088718 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.089514 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.090615 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.090960 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.091032 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.091196 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.091233 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.091287 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:03.091358 (+ 71us) server_negotiation.cc:299] Negotiation successful
0924 17:33:03.091380 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
I20260924 17:33:03.096815 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.093871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:40979 (local address 127.6.37.1:43523)
0924 17:33:03.093930 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:03.093932 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:03.093940 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:03.093960 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:03.093961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:03.093970 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:03.094028 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:03.094170 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.094991 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.095995 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.096292 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.096368 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.096536 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.096569 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.096621 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:03.096697 (+ 76us) server_negotiation.cc:299] Negotiation successful
0924 17:33:03.096715 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:33:03.096827 8603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:03.093684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.6.37.1:40979)
0924 17:33:03.093761 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:03.093771 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:03.093808 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:03.094053 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:03.094054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:03.094056 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:03.094097 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.094098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.095066 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.095068 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.095900 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:03.095903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:03.096384 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:03.096385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:03.096445 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:03.096453 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:03.096638 (+ 185us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:03.096641 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:03.096686 (+ 45us) client_negotiation.cc:240] Negotiation successful
0924 17:33:03.096731 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260924 17:33:03.099671 8488 raft_consensus.cc:1261] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Refusing update from remote peer 0fab16ca0ba547dda4b270ce2c88ea9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:03.099704 8345 raft_consensus.cc:1261] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Refusing update from remote peer 0fab16ca0ba547dda4b270ce2c88ea9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:03.099860 8582 consensus_queue.cc:1035] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:03.100060 8582 consensus_queue.cc:1035] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260924 17:33:03.106066 8587 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260924 17:33:04.628254 8045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:04.628376 8045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:04.629247 8045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Sending DeleteTablet for 3 replicas of tablet 0a660199364b43fd9905e4e749bbbe95
I20260924 17:33:04.629545 8182 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a660199364b43fd9905e4e749bbbe95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44296
I20260924 17:33:04.629596 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a660199364b43fd9905e4e749bbbe95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44692
I20260924 17:33:04.629788 8468 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a660199364b43fd9905e4e749bbbe95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:47654
I20260924 17:33:04.630072 8638 tablet_replica.cc:330] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: stopping tablet replica
I20260924 17:33:04.630162 8638 raft_consensus.cc:2229] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:04.630210 8638 raft_consensus.cc:2258] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:04.632135 8638 ts_tablet_manager.cc:1905] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:04.632159 8636 tablet_replica.cc:330] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: stopping tablet replica
I20260924 17:33:04.632211 8636 raft_consensus.cc:2229] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:04.632292 8636 raft_consensus.cc:2258] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:04.632560 8636 ts_tablet_manager.cc:1905] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:04.634366 8638 ts_tablet_manager.cc:1918] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 17:33:04.634443 8638 log.cc:1196] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/0a660199364b43fd9905e4e749bbbe95
I20260924 17:33:04.634517 8636 ts_tablet_manager.cc:1918] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 17:33:04.634582 8636 log.cc:1196] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/0a660199364b43fd9905e4e749bbbe95
I20260924 17:33:04.634848 8636 ts_tablet_manager.cc:1939] T 0a660199364b43fd9905e4e749bbbe95 P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting consensus metadata
I20260924 17:33:04.634759 8638 ts_tablet_manager.cc:1939] T 0a660199364b43fd9905e4e749bbbe95 P d8e1657cdf154bc18d2995b5002dfc9b: Deleting consensus metadata
I20260924 17:33:04.635265 8029 catalog_manager.cc:4841] TS d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377): tablet 0a660199364b43fd9905e4e749bbbe95 (table test-table [id=3fb37cf294bd493c848dc6be981e6f98]) successfully deleted
I20260924 17:33:04.635347 8029 catalog_manager.cc:4841] TS 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523): tablet 0a660199364b43fd9905e4e749bbbe95 (table test-table [id=3fb37cf294bd493c848dc6be981e6f98]) successfully deleted
I20260924 17:33:04.637178 8637 tablet_replica.cc:330] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: stopping tablet replica
I20260924 17:33:04.637262 8637 raft_consensus.cc:2229] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:04.637310 8637 raft_consensus.cc:2258] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:04.637521 8637 ts_tablet_manager.cc:1905] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:04.638799 8637 ts_tablet_manager.cc:1918] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 17:33:04.638875 8637 log.cc:1196] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/0a660199364b43fd9905e4e749bbbe95
I20260924 17:33:04.639108 8637 ts_tablet_manager.cc:1939] T 0a660199364b43fd9905e4e749bbbe95 P b80d447219cd4dadaa47e956a361707c: Deleting consensus metadata
I20260924 17:33:04.639478 8031 catalog_manager.cc:4841] TS b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583): tablet 0a660199364b43fd9905e4e749bbbe95 (table test-table [id=3fb37cf294bd493c848dc6be981e6f98]) successfully deleted
Sep 24 17:33:04 dist-test-slave-gcz9 krb5kdc[8000](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271184, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 17:33:04 dist-test-slave-gcz9 krb5kdc[8000](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271184, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:04.679852 8647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:04.648564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57678 (local address 127.6.37.62:44215)
0924 17:33:04.648701 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:04.648703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:04.648749 (+ 46us) server_negotiation.cc:407] Connection header received
0924 17:33:04.648829 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:04.648829 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:04.648840 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:04.648899 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:04.649422 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:04.649938 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:04.650680 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:04.650867 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:04.650977 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:04.677213 (+ 26236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:04.677215 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:04.677216 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:04.677224 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:04.678826 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:04.679202 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:04.679203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:04.679203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:04.679256 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:04.679426 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:04.679426 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:04.679427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:04.679546 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:04.679685 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:04.679712 (+ 27us) server_negotiation.cc:299] Negotiation successful
0924 17:33:04.679781 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260924 17:33:04.681425 8045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:04.681582 8045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:04.682965 8468 tablet_service.cc:1467] Processing CreateTablet for tablet 90132bdaca9e4f629e5b965db911bee0 (DEFAULT_TABLE table=test-table [id=33a3c7c66f9b49438aad69f800105a91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:04.683010 8325 tablet_service.cc:1467] Processing CreateTablet for tablet 90132bdaca9e4f629e5b965db911bee0 (DEFAULT_TABLE table=test-table [id=33a3c7c66f9b49438aad69f800105a91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:04.682976 8182 tablet_service.cc:1467] Processing CreateTablet for tablet 90132bdaca9e4f629e5b965db911bee0 (DEFAULT_TABLE table=test-table [id=33a3c7c66f9b49438aad69f800105a91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:04.683130 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90132bdaca9e4f629e5b965db911bee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:04.683131 8468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90132bdaca9e4f629e5b965db911bee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:04.683154 8182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90132bdaca9e4f629e5b965db911bee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:04.684327 8648 tablet_bootstrap.cc:492] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Bootstrap starting.
I20260924 17:33:04.684706 8649 tablet_bootstrap.cc:492] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Bootstrap starting.
I20260924 17:33:04.684886 8650 tablet_bootstrap.cc:492] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Bootstrap starting.
I20260924 17:33:04.685204 8648 tablet_bootstrap.cc:654] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:04.685214 8649 tablet_bootstrap.cc:654] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:04.685328 8650 tablet_bootstrap.cc:654] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:04.685906 8649 tablet_bootstrap.cc:492] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: No bootstrap required, opened a new log
I20260924 17:33:04.685957 8650 tablet_bootstrap.cc:492] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: No bootstrap required, opened a new log
I20260924 17:33:04.685974 8649 ts_tablet_manager.cc:1397] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:04.686021 8650 ts_tablet_manager.cc:1397] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:04.686141 8650 raft_consensus.cc:348] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.686147 8649 raft_consensus.cc:348] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.686209 8650 raft_consensus.cc:374] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:04.686228 8650 raft_consensus.cc:729] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Initialized, Role: FOLLOWER
I20260924 17:33:04.686230 8649 raft_consensus.cc:374] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:04.686255 8649 raft_consensus.cc:729] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80d447219cd4dadaa47e956a361707c, State: Initialized, Role: FOLLOWER
I20260924 17:33:04.686286 8650 consensus_queue.cc:260] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.686307 8649 consensus_queue.cc:260] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.686467 8650 ts_tablet_manager.cc:1428] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:04.686492 8649 ts_tablet_manager.cc:1428] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:04.686847 8648 tablet_bootstrap.cc:492] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: No bootstrap required, opened a new log
I20260924 17:33:04.686925 8648 ts_tablet_manager.cc:1397] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260924 17:33:04.687132 8648 raft_consensus.cc:348] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.687229 8648 raft_consensus.cc:374] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:04.687258 8648 raft_consensus.cc:729] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Initialized, Role: FOLLOWER
I20260924 17:33:04.687305 8648 consensus_queue.cc:260] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.687496 8648 ts_tablet_manager.cc:1428] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:04.709648 8654 raft_consensus.cc:482] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:04.709729 8654 raft_consensus.cc:504] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.709918 8654 leader_election.cc:288] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523), b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583)
I20260924 17:33:04.710116 8203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90132bdaca9e4f629e5b965db911bee0" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" is_pre_election: true
I20260924 17:33:04.710115 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90132bdaca9e4f629e5b965db911bee0" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c" is_pre_election: true
I20260924 17:33:04.710210 8345 raft_consensus.cc:2454] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 0.
I20260924 17:33:04.710210 8203 raft_consensus.cc:2454] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 0.
I20260924 17:33:04.710376 8420 leader_election.cc:302] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b80d447219cd4dadaa47e956a361707c, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:04.710484 8654 raft_consensus.cc:2781] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:04.710525 8654 raft_consensus.cc:482] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:04.710551 8654 raft_consensus.cc:3037] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:04.711295 8654 raft_consensus.cc:504] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.711488 8654 leader_election.cc:288] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 election: Requested vote from peers 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523), b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583)
I20260924 17:33:04.711572 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90132bdaca9e4f629e5b965db911bee0" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b80d447219cd4dadaa47e956a361707c"
I20260924 17:33:04.711580 8203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90132bdaca9e4f629e5b965db911bee0" candidate_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f"
I20260924 17:33:04.711691 8345 raft_consensus.cc:3037] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:04.711688 8203 raft_consensus.cc:3037] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:04.712388 8203 raft_consensus.cc:2454] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 1.
I20260924 17:33:04.712577 8418 leader_election.cc:302] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fab16ca0ba547dda4b270ce2c88ea9f, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:04.712674 8654 raft_consensus.cc:2781] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:04.712671 8345 raft_consensus.cc:2454] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8e1657cdf154bc18d2995b5002dfc9b in term 1.
I20260924 17:33:04.712847 8654 raft_consensus.cc:686] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 LEADER]: Becoming Leader. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Running, Role: LEADER
I20260924 17:33:04.712908 8654 consensus_queue.cc:237] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.713531 8043 catalog_manager.cc:5495] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b reported cstate change: term changed from 0 to 1, leader changed from <none> to d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3). New cstate: current_term: 1 leader_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } health_report { overall_health: HEALTHY } } }
I20260924 17:33:04.727433 8659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:04.725137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.6.37.3:43377)
0924 17:33:04.725307 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:04.725309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:04.725321 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:33:04.725342 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:04.725343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:04.725352 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:04.725434 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:04.725552 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:04.726021 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:04.726771 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:04.727009 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:04.727062 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:04.727195 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:04.727221 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:04.727254 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:04.727326 (+ 72us) server_negotiation.cc:299] Negotiation successful
0924 17:33:04.727343 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":89,"threads_started":1}
I20260924 17:33:04.729681 8345 raft_consensus.cc:1261] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Refusing update from remote peer d8e1657cdf154bc18d2995b5002dfc9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:04.729722 8203 raft_consensus.cc:1261] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Refusing update from remote peer d8e1657cdf154bc18d2995b5002dfc9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:04.729908 8654 consensus_queue.cc:1035] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:04.730005 8656 consensus_queue.cc:1035] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:04.741128 8043 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:04.741247 8043 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:04.741868 8043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Sending DeleteTablet for 3 replicas of tablet 90132bdaca9e4f629e5b965db911bee0
I20260924 17:33:04.742141 8468 tablet_service.cc:1514] Processing DeleteTablet for tablet 90132bdaca9e4f629e5b965db911bee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:47654
I20260924 17:33:04.742188 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet 90132bdaca9e4f629e5b965db911bee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44692
I20260924 17:33:04.742192 8182 tablet_service.cc:1514] Processing DeleteTablet for tablet 90132bdaca9e4f629e5b965db911bee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44296
I20260924 17:33:04.742239 8638 tablet_replica.cc:330] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: stopping tablet replica
I20260924 17:33:04.742280 8637 tablet_replica.cc:330] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: stopping tablet replica
I20260924 17:33:04.742280 8636 tablet_replica.cc:330] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: stopping tablet replica
I20260924 17:33:04.742293 8638 raft_consensus.cc:2229] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:04.742331 8637 raft_consensus.cc:2229] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:04.742329 8636 raft_consensus.cc:2229] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:04.742352 8638 raft_consensus.cc:2258] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:04.742376 8636 raft_consensus.cc:2258] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:04.742394 8637 raft_consensus.cc:2258] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:04.742671 8637 ts_tablet_manager.cc:1905] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:04.742693 8636 ts_tablet_manager.cc:1905] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:04.742718 8638 ts_tablet_manager.cc:1905] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:04.742728 8043 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:04.742859 8043 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:04.743947 8468 tablet_service.cc:1467] Processing CreateTablet for tablet ee2791ade8ff454abe1de3fa5b7fbfea (DEFAULT_TABLE table=test-table [id=43e7553817924b68a8a1b4d0d4ab05f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:04.744045 8468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee2791ade8ff454abe1de3fa5b7fbfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:04.744764 8638 ts_tablet_manager.cc:1918] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:04.744766 8637 ts_tablet_manager.cc:1918] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:04.744818 8638 log.cc:1196] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/90132bdaca9e4f629e5b965db911bee0
I20260924 17:33:04.744839 8637 log.cc:1196] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/90132bdaca9e4f629e5b965db911bee0
I20260924 17:33:04.745054 8638 ts_tablet_manager.cc:1939] T 90132bdaca9e4f629e5b965db911bee0 P d8e1657cdf154bc18d2995b5002dfc9b: Deleting consensus metadata
I20260924 17:33:04.745074 8637 ts_tablet_manager.cc:1939] T 90132bdaca9e4f629e5b965db911bee0 P b80d447219cd4dadaa47e956a361707c: Deleting consensus metadata
I20260924 17:33:04.745360 8636 ts_tablet_manager.cc:1918] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:04.745359 8029 catalog_manager.cc:4841] TS d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377): tablet 90132bdaca9e4f629e5b965db911bee0 (table test-table [id=33a3c7c66f9b49438aad69f800105a91]) successfully deleted
I20260924 17:33:04.745410 8325 tablet_service.cc:1467] Processing CreateTablet for tablet ee2791ade8ff454abe1de3fa5b7fbfea (DEFAULT_TABLE table=test-table [id=43e7553817924b68a8a1b4d0d4ab05f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:04.745410 8182 tablet_service.cc:1467] Processing CreateTablet for tablet ee2791ade8ff454abe1de3fa5b7fbfea (DEFAULT_TABLE table=test-table [id=43e7553817924b68a8a1b4d0d4ab05f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:04.745520 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee2791ade8ff454abe1de3fa5b7fbfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:04.745422 8636 log.cc:1196] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/90132bdaca9e4f629e5b965db911bee0
I20260924 17:33:04.745747 8636 ts_tablet_manager.cc:1939] T 90132bdaca9e4f629e5b965db911bee0 P 0fab16ca0ba547dda4b270ce2c88ea9f: Deleting consensus metadata
I20260924 17:33:04.746060 8029 catalog_manager.cc:4841] TS 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523): tablet 90132bdaca9e4f629e5b965db911bee0 (table test-table [id=33a3c7c66f9b49438aad69f800105a91]) successfully deleted
I20260924 17:33:04.746157 8650 tablet_bootstrap.cc:492] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Bootstrap starting.
I20260924 17:33:04.746472 8650 tablet_bootstrap.cc:654] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:04.745519 8182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee2791ade8ff454abe1de3fa5b7fbfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:04.746713 8649 tablet_bootstrap.cc:492] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Bootstrap starting.
I20260924 17:33:04.747184 8650 tablet_bootstrap.cc:492] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: No bootstrap required, opened a new log
I20260924 17:33:04.747226 8650 ts_tablet_manager.cc:1397] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:04.747325 8650 raft_consensus.cc:348] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.747418 8650 raft_consensus.cc:374] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:04.747437 8650 raft_consensus.cc:729] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8e1657cdf154bc18d2995b5002dfc9b, State: Initialized, Role: FOLLOWER
I20260924 17:33:04.747489 8650 consensus_queue.cc:260] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.747597 8650 ts_tablet_manager.cc:1428] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:04.747789 8649 tablet_bootstrap.cc:654] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:04.748214 8648 tablet_bootstrap.cc:492] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f: Bootstrap starting.
I20260924 17:33:04.748281 8031 catalog_manager.cc:4841] TS b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583): tablet 90132bdaca9e4f629e5b965db911bee0 (table test-table [id=33a3c7c66f9b49438aad69f800105a91]) successfully deleted
I20260924 17:33:04.748688 8648 tablet_bootstrap.cc:654] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:04.748791 8649 tablet_bootstrap.cc:492] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: No bootstrap required, opened a new log
I20260924 17:33:04.748847 8649 ts_tablet_manager.cc:1397] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:33:04.749097 8649 raft_consensus.cc:348] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.749202 8649 raft_consensus.cc:374] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:04.749228 8649 raft_consensus.cc:729] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80d447219cd4dadaa47e956a361707c, State: Initialized, Role: FOLLOWER
I20260924 17:33:04.749295 8648 tablet_bootstrap.cc:492] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f: No bootstrap required, opened a new log
I20260924 17:33:04.749271 8649 consensus_queue.cc:260] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.749343 8648 ts_tablet_manager.cc:1397] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:04.749377 8649 ts_tablet_manager.cc:1428] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:04.749445 8648 raft_consensus.cc:348] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.749505 8648 raft_consensus.cc:374] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:04.749536 8648 raft_consensus.cc:729] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fab16ca0ba547dda4b270ce2c88ea9f, State: Initialized, Role: FOLLOWER
I20260924 17:33:04.749574 8648 consensus_queue.cc:260] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:04.749722 8648 ts_tablet_manager.cc:1428] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:05.083379 8655 raft_consensus.cc:482] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:05.083534 8655 raft_consensus.cc:504] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:05.083966 8655 leader_election.cc:288] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523), d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:05.088038 8659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.084422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:52121 (local address 127.6.37.3:43377)
0924 17:33:05.084514 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:05.084516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:05.084663 (+ 147us) server_negotiation.cc:407] Connection header received
0924 17:33:05.084738 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:05.084739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:05.084751 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:05.084858 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:05.084964 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.085526 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.087024 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.087598 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.087678 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.087690 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:05.087935 (+ 245us) server_negotiation.cc:299] Negotiation successful
0924 17:33:05.087985 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260924 17:33:05.088075 8670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.084348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:43377 (local address 127.6.37.2:52121)
0924 17:33:05.084605 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:05.084614 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:05.084668 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:05.084826 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:05.084827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:05.084829 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:05.084898 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.084899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.085594 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.085595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.086932 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.086935 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.087698 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.087699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.087847 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.087850 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:05.087906 (+ 56us) client_negotiation.cc:240] Negotiation successful
0924 17:33:05.087934 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":4,"thread_start_us":217,"threads_started":1}
I20260924 17:33:05.088307 8669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.084224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:53235 (local address 127.6.37.1:43523)
0924 17:33:05.084362 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:05.084366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:05.084401 (+ 35us) server_negotiation.cc:407] Connection header received
0924 17:33:05.084446 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:05.084447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:05.084459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:05.084567 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:05.084754 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.085379 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.087027 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.087620 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.087696 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.087709 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:05.088150 (+ 441us) server_negotiation.cc:299] Negotiation successful
0924 17:33:05.088234 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260924 17:33:05.088320 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee2791ade8ff454abe1de3fa5b7fbfea" candidate_uuid: "b80d447219cd4dadaa47e956a361707c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" is_pre_election: true
I20260924 17:33:05.088075 8668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.084144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.6.37.2:53235)
0924 17:33:05.084276 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:05.084288 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:05.084343 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:05.084575 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:05.084576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:05.084579 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:05.084656 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.084659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.085479 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.085480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.086936 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.086939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.087697 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.087698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.087782 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.087786 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:05.087883 (+ 97us) client_negotiation.cc:240] Negotiation successful
0924 17:33:05.087934 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":46,"thread_start_us":84,"threads_started":1}
I20260924 17:33:05.088418 8488 raft_consensus.cc:2454] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b80d447219cd4dadaa47e956a361707c in term 0.
I20260924 17:33:05.088624 8276 leader_election.cc:302] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b80d447219cd4dadaa47e956a361707c, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:05.088786 8655 raft_consensus.cc:2781] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:05.088836 8655 raft_consensus.cc:482] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:05.088794 8203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee2791ade8ff454abe1de3fa5b7fbfea" candidate_uuid: "b80d447219cd4dadaa47e956a361707c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" is_pre_election: true
I20260924 17:33:05.088863 8655 raft_consensus.cc:3037] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:05.088886 8203 raft_consensus.cc:2454] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b80d447219cd4dadaa47e956a361707c in term 0.
I20260924 17:33:05.089847 8655 raft_consensus.cc:504] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:05.090013 8655 leader_election.cc:288] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [CANDIDATE]: Term 1 election: Requested vote from peers 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523), d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377)
I20260924 17:33:05.090180 8203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee2791ade8ff454abe1de3fa5b7fbfea" candidate_uuid: "b80d447219cd4dadaa47e956a361707c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f"
I20260924 17:33:05.090255 8203 raft_consensus.cc:3037] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:05.090188 8488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee2791ade8ff454abe1de3fa5b7fbfea" candidate_uuid: "b80d447219cd4dadaa47e956a361707c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8e1657cdf154bc18d2995b5002dfc9b"
I20260924 17:33:05.090286 8488 raft_consensus.cc:3037] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:05.090858 8488 raft_consensus.cc:2454] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b80d447219cd4dadaa47e956a361707c in term 1.
I20260924 17:33:05.090970 8203 raft_consensus.cc:2454] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b80d447219cd4dadaa47e956a361707c in term 1.
I20260924 17:33:05.091101 8276 leader_election.cc:302] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b80d447219cd4dadaa47e956a361707c, d8e1657cdf154bc18d2995b5002dfc9b; no voters:
I20260924 17:33:05.091217 8655 raft_consensus.cc:2781] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:05.091391 8655 raft_consensus.cc:686] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 1 LEADER]: Becoming Leader. State: Replica: b80d447219cd4dadaa47e956a361707c, State: Running, Role: LEADER
I20260924 17:33:05.091473 8655 consensus_queue.cc:237] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } }
I20260924 17:33:05.092283 8045 catalog_manager.cc:5495] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c reported cstate change: term changed from 0 to 1, leader changed from <none> to b80d447219cd4dadaa47e956a361707c (127.6.37.2). New cstate: current_term: 1 leader_uuid: "b80d447219cd4dadaa47e956a361707c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b80d447219cd4dadaa47e956a361707c" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:05.105360 8673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.102779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44696 (local address 127.6.37.2:37583)
0924 17:33:05.102948 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:05.102950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:05.102959 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:05.103007 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:05.103007 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:05.103026 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:05.103102 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:05.103202 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.103677 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.104354 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.104571 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.104636 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.104890 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:05.105003 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:05.105073 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:05.105114 (+ 41us) server_negotiation.cc:299] Negotiation successful
0924 17:33:05.105132 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":120,"threads_started":1}
I20260924 17:33:05.110316 8669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.107873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:54439 (local address 127.6.37.1:43523)
0924 17:33:05.107935 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:05.107937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:05.107946 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:05.108004 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:05.108005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:05.108017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:05.108080 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:05.108339 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.108792 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.109594 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.109790 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.109866 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.110059 (+ 193us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:05.110096 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:05.110160 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:05.110224 (+ 64us) server_negotiation.cc:299] Negotiation successful
0924 17:33:05.110245 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:33:05.110344 8676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.107691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.6.37.2:54439)
0924 17:33:05.107864 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:05.107873 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:05.107940 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:05.108099 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:05.108100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:05.108102 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:05.108254 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.108255 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.108876 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.108877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.109472 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.109474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.109878 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.109879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.109947 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.109959 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:05.110163 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:05.110166 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:05.110218 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:33:05.110264 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":71,"threads_started":1}
I20260924 17:33:05.112614 8203 raft_consensus.cc:1261] T ee2791ade8ff454abe1de3fa5b7fbfea P 0fab16ca0ba547dda4b270ce2c88ea9f [term 1 FOLLOWER]: Refusing update from remote peer b80d447219cd4dadaa47e956a361707c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:05.112618 8488 raft_consensus.cc:1261] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Refusing update from remote peer b80d447219cd4dadaa47e956a361707c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:05.112859 8671 consensus_queue.cc:1035] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fab16ca0ba547dda4b270ce2c88ea9f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:05.112984 8655 consensus_queue.cc:1035] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8e1657cdf154bc18d2995b5002dfc9b" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:05.121100 8673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.118433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:55535 (local address 127.6.37.2:37583)
0924 17:33:05.118472 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:05.118474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:05.118578 (+ 104us) server_negotiation.cc:407] Connection header received
0924 17:33:05.118649 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:05.118650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:05.118659 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:05.118697 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:05.118814 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.119347 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.120468 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.120649 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.120701 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.120928 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:05.120952 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:05.120988 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:05.121037 (+ 49us) server_negotiation.cc:299] Negotiation successful
0924 17:33:05.121052 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:33:05.121131 8680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:05.118295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37583 (local address 127.6.37.1:55535)
0924 17:33:05.118498 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:05.118510 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:05.118573 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:05.118700 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:05.118700 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:05.118701 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:05.118759 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.118761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.119421 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.119422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.120386 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:05.120389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:05.120722 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:05.120723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:05.120853 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:05.120859 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:05.120991 (+ 132us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:05.120992 (+ 1us) client_negotiation.cc:769] Sending connection context
0924 17:33:05.121034 (+ 42us) client_negotiation.cc:240] Negotiation successful
0924 17:33:05.121073 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":120,"threads_started":1}
W20260924 17:33:05.121505 8621 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260924 17:33:06.645375 8045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:06.645478 8045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:06.646235 8045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 223e9ed9eae34df688dfb4929c90f8d7: Sending DeleteTablet for 3 replicas of tablet ee2791ade8ff454abe1de3fa5b7fbfea
I20260924 17:33:06.646507 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet ee2791ade8ff454abe1de3fa5b7fbfea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:06 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44692
I20260924 17:33:06.646528 8182 tablet_service.cc:1514] Processing DeleteTablet for tablet ee2791ade8ff454abe1de3fa5b7fbfea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:06 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:44296
I20260924 17:33:06.646658 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8117
I20260924 17:33:06.646688 8468 tablet_service.cc:1514] Processing DeleteTablet for tablet ee2791ade8ff454abe1de3fa5b7fbfea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:06 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:47654
I20260924 17:33:06.648998 8706 tablet_replica.cc:330] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: stopping tablet replica
I20260924 17:33:06.649056 8706 raft_consensus.cc:2229] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:06.649083 8706 raft_consensus.cc:2258] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:06.649197 8704 tablet_replica.cc:330] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: stopping tablet replica
I20260924 17:33:06.649298 8704 raft_consensus.cc:2229] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:06.649356 8706 ts_tablet_manager.cc:1905] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:06.649415 8704 raft_consensus.cc:2258] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:06.649682 8704 ts_tablet_manager.cc:1905] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:06.651182 8704 ts_tablet_manager.cc:1918] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 17:33:06.651262 8704 log.cc:1196] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/ee2791ade8ff454abe1de3fa5b7fbfea
I20260924 17:33:06.651253 8706 ts_tablet_manager.cc:1918] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260924 17:33:06.651309 8706 log.cc:1196] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/ee2791ade8ff454abe1de3fa5b7fbfea
I20260924 17:33:06.651551 8704 ts_tablet_manager.cc:1939] T ee2791ade8ff454abe1de3fa5b7fbfea P b80d447219cd4dadaa47e956a361707c: Deleting consensus metadata
I20260924 17:33:06.651602 8706 ts_tablet_manager.cc:1939] T ee2791ade8ff454abe1de3fa5b7fbfea P d8e1657cdf154bc18d2995b5002dfc9b: Deleting consensus metadata
I20260924 17:33:06.651880 8031 catalog_manager.cc:4841] TS b80d447219cd4dadaa47e956a361707c (127.6.37.2:37583): tablet ee2791ade8ff454abe1de3fa5b7fbfea (table test-table [id=43e7553817924b68a8a1b4d0d4ab05f9]) successfully deleted
I20260924 17:33:06.651952 8029 catalog_manager.cc:4841] TS d8e1657cdf154bc18d2995b5002dfc9b (127.6.37.3:43377): tablet ee2791ade8ff454abe1de3fa5b7fbfea (table test-table [id=43e7553817924b68a8a1b4d0d4ab05f9]) successfully deleted
W20260924 17:33:06.655854 8029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:43523 (error 108)
I20260924 17:33:06.656023 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8259
I20260924 17:33:06.657105 8708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:06.656873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43523 (local address 127.0.0.1:44328)
0924 17:33:06.657011 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:06.657059 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:43523: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
W20260924 17:33:06.657199 8029 catalog_manager.cc:4584] TS 0fab16ca0ba547dda4b270ce2c88ea9f (127.6.37.1:43523): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ee2791ade8ff454abe1de3fa5b7fbfea: Network error: Client connection negotiation failed: client connection to 127.6.37.1:43523: connect: Connection refused (error 111)
I20260924 17:33:06.663156 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8402
I20260924 17:33:06.669154 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8013
2026-09-24T17:33:06Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5927 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:06 dist-test-slave-gcz9 krb5kdc[8711](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:06 dist-test-slave-gcz9 krb5kdc[8711](info): set up 2 sockets
Sep 24 17:33:06 dist-test-slave-gcz9 krb5kdc[8711](info): commencing operation
krb5kdc: starting...
W20260924 17:33:07.744459 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:07 dist-test-slave-gcz9 krb5kdc[8711](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:07.865938 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:36265
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:36265
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:07.946631 8726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:07.946888 8726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:07.946954 8726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:07.948148 8726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:07.948227 8726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:07.948253 8726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:07.948282 8726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:07.948310 8726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:07.949815 8726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:36265
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:36265
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:07.950093 8726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:07.950330 8726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:07.955608 8731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:07.955734 8734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:07.955775 8732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:07.955714 8726 server_base.cc:1034] running on GCE node
I20260924 17:33:07.956185 8726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:07.956472 8726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:07.957634 8726 hybrid_clock.cc:648] HybridClock initialized: now 1790271187957615 us; error 45 us; skew 500 ppm
Sep 24 17:33:07 dist-test-slave-gcz9 krb5kdc[8711](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271187, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:07.960005 8726 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:07.960467 8726 webserver.cc:460] Webserver started at http://127.6.37.62:44893/ using document root <none> and password file <none>
I20260924 17:33:07.960672 8726 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:07.960713 8726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:07.960800 8726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:07.961760 8726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "0672adead06241bb87f371b6013c4d7d"
format_stamp: "Formatted at 2026-09-24 17:33:07 on dist-test-slave-gcz9"
server_key: "e6e6dbc68dafcc2e96011f662d949a64"
server_key_iv: "550a0d25390b75b936f4b14f2293f37d"
server_key_version: "encryptionkey@0"
I20260924 17:33:07.962045 8726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "0672adead06241bb87f371b6013c4d7d"
format_stamp: "Formatted at 2026-09-24 17:33:07 on dist-test-slave-gcz9"
server_key: "e6e6dbc68dafcc2e96011f662d949a64"
server_key_iv: "550a0d25390b75b936f4b14f2293f37d"
server_key_version: "encryptionkey@0"
I20260924 17:33:07.963311 8726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:07.964016 8741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:07.964182 8726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:07.964269 8726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "0672adead06241bb87f371b6013c4d7d"
format_stamp: "Formatted at 2026-09-24 17:33:07 on dist-test-slave-gcz9"
server_key: "e6e6dbc68dafcc2e96011f662d949a64"
server_key_iv: "550a0d25390b75b936f4b14f2293f37d"
server_key_version: "encryptionkey@0"
I20260924 17:33:07.964339 8726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:07.981339 8726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:07.983669 8726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:07.983774 8726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:07.987483 8726 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:36265
I20260924 17:33:07.987538 8793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:36265 every 8 connection(s)
I20260924 17:33:07.987875 8726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:07.988711 8794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:07.990650 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8726
I20260924 17:33:07.990739 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:07.990938 6292 external_mini_cluster.cc:1428] Setting key ccccf1eca785e604bc2b354c07beb04e
I20260924 17:33:07.991127 8794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d: Bootstrap starting.
I20260924 17:33:07.991854 8794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:07.992197 8794 log.cc:824] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:07.992930 8794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d: No bootstrap required, opened a new log
I20260924 17:33:07.995319 8794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0672adead06241bb87f371b6013c4d7d" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36265 } }
I20260924 17:33:07.995494 8794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:07.995530 8794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0672adead06241bb87f371b6013c4d7d, State: Initialized, Role: FOLLOWER
I20260924 17:33:07.995644 8794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0672adead06241bb87f371b6013c4d7d" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36265 } }
I20260924 17:33:07.995715 8794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:07.995744 8794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:07.995780 8794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:07.996445 8794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0672adead06241bb87f371b6013c4d7d" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36265 } }
I20260924 17:33:07.996570 8794 leader_election.cc:302] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0672adead06241bb87f371b6013c4d7d; no voters:
I20260924 17:33:07.996745 8794 leader_election.cc:288] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:07.996826 8799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:07.997035 8799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [term 1 LEADER]: Becoming Leader. State: Replica: 0672adead06241bb87f371b6013c4d7d, State: Running, Role: LEADER
I20260924 17:33:07.997051 8794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:07.997155 8799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0672adead06241bb87f371b6013c4d7d" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36265 } }
I20260924 17:33:07.997547 8799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0672adead06241bb87f371b6013c4d7d. Latest consensus state: current_term: 1 leader_uuid: "0672adead06241bb87f371b6013c4d7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0672adead06241bb87f371b6013c4d7d" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36265 } } }
I20260924 17:33:07.997786 8799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:07.997712 8800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0672adead06241bb87f371b6013c4d7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0672adead06241bb87f371b6013c4d7d" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36265 } } }
I20260924 17:33:07.998237 8800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:07.998366 8808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 24 17:33:07 dist-test-slave-gcz9 krb5kdc[8711](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:07.998821 8808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:08.000974 8808 catalog_manager.cc:1347] Generated new cluster ID: c088c875305b427b969db1778c4ca0b8
I20260924 17:33:08.001034 8808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:08.003440 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:07.991465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.6.37.62:36265)
0924 17:33:07.991657 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:07.991665 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:07.991696 (+ 31us) server_negotiation.cc:407] Connection header received
0924 17:33:07.992276 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:07.992285 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:07.992348 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:07.992482 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:07.993226 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:07.994611 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:07.995452 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:07.996071 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:07.996190 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:07.999193 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:07.999196 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:07.999197 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:07.999209 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:08.001567 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.001940 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.001943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.001943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.002036 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.002217 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.002217 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.002218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.002477 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:08.003052 (+ 575us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:08.003117 (+ 65us) server_negotiation.cc:299] Negotiation successful
0924 17:33:08.003237 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":77,"threads_started":1}
I20260924 17:33:08.010373 8808 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:08.010927 8808 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:08.013790 8808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0672adead06241bb87f371b6013c4d7d: Generated new TSK 0
I20260924 17:33:08.013964 8808 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:33:08.045631 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36265
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:08.126161 8820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:08.126356 8820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:08.126379 8820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:08.127548 8820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:08.127590 8820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:08.127617 8820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:08.129056 8820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:08.129285 8820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:08.129535 8820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:08.134351 8825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:08.134502 8828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:08.134526 8826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:08.134761 8820 server_base.cc:1034] running on GCE node
I20260924 17:33:08.135033 8820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:08.135236 8820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:08.136376 8820 hybrid_clock.cc:648] HybridClock initialized: now 1790271188136362 us; error 31 us; skew 500 ppm
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[8711](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271188, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:08.138756 8820 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:33:08.139262 8820 webserver.cc:460] Webserver started at http://127.6.37.1:41047/ using document root <none> and password file <none>
I20260924 17:33:08.139442 8820 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:08.139482 8820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:08.139572 8820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:08.140518 8820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "92ace8440ff84c999b6446223596f32e"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "f6e04e4832c46aace2db522c110fbddd"
server_key_iv: "5c44151b0b95519250ee615fd283078a"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.140805 8820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "92ace8440ff84c999b6446223596f32e"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "f6e04e4832c46aace2db522c110fbddd"
server_key_iv: "5c44151b0b95519250ee615fd283078a"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.142042 8820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:08.142704 8835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.142935 8820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:08.143054 8820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "92ace8440ff84c999b6446223596f32e"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "f6e04e4832c46aace2db522c110fbddd"
server_key_iv: "5c44151b0b95519250ee615fd283078a"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.143134 8820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:08.155236 8820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:08.157145 8820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:08.157315 8820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:08.157541 8820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:08.157867 8820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:08.157934 8820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.157979 8820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:08.158010 8820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.164508 8820 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:34911
I20260924 17:33:08.164539 8949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:34911 every 8 connection(s)
I20260924 17:33:08.164873 8820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:08.170373 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8820
I20260924 17:33:08.170468 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:08.170670 6292 external_mini_cluster.cc:1428] Setting key dcca646218ee4086c8f178063b2597f7
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[8711](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271188, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:08.175247 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:08.165717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:50481 (local address 127.6.37.62:36265)
0924 17:33:08.165780 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:08.165783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:08.165993 (+ 210us) server_negotiation.cc:407] Connection header received
0924 17:33:08.166467 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:08.166468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:08.166480 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:08.166547 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:08.167579 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.168326 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.169350 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.169586 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.169672 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:08.172102 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:08.172104 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:08.172104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:08.172112 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:08.173786 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.174167 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.174168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.174169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.174233 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.174473 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.174474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.174475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.174621 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:08.174689 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:08.174989 (+ 300us) server_negotiation.cc:299] Negotiation successful
0924 17:33:08.175120 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:33:08.175299 8952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:08.165661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36265 (local address 127.6.37.1:50481)
0924 17:33:08.165857 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:08.165900 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:08.166369 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:08.166600 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:08.166603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:08.167286 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:08.167474 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:08.167479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.168434 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.168435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:08.169243 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:08.169245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.169782 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.169783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:08.169889 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:08.170395 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:08.170406 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:08.171997 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:08.173871 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:08.173877 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:08.173879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:08.174091 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:08.174307 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:08.174308 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:08.174308 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:08.174406 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:08.174688 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:08.174693 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:08.174823 (+ 130us) client_negotiation.cc:769] Sending connection context
0924 17:33:08.174962 (+ 139us) client_negotiation.cc:240] Negotiation successful
0924 17:33:08.175086 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":111,"threads_started":1}
I20260924 17:33:08.175854 8950 heartbeater.cc:347] Connected to a master server at 127.6.37.62:36265
I20260924 17:33:08.175961 8950 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:08.176149 8950 heartbeater.cc:511] Master 127.6.37.62:36265 requested a full tablet report, sending...
I20260924 17:33:08.176714 8758 ts_manager.cc:194] Registered new tserver with Master: 92ace8440ff84c999b6446223596f32e (127.6.37.1:34911)
I20260924 17:33:08.177700 8758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:50481
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:33:08.198717 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36265
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:08.279201 8955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:08.279386 8955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:08.279408 8955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:08.280522 8955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:08.280562 8955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:08.280586 8955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:08.282038 8955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:08.282274 8955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:08.282516 8955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:33:08.288136 8955 server_base.cc:1034] running on GCE node
W20260924 17:33:08.288048 8961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:08.287955 8960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:08.287955 8963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:08.288602 8955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:08.288880 8955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:08.290055 8955 hybrid_clock.cc:648] HybridClock initialized: now 1790271188290029 us; error 39 us; skew 500 ppm
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[8711](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271188, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:08.292868 8955 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:33:08.293356 8955 webserver.cc:460] Webserver started at http://127.6.37.2:41803/ using document root <none> and password file <none>
I20260924 17:33:08.293594 8955 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:08.293642 8955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:08.293810 8955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:08.294936 8955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "f7e89bb87ce14b93affb0ece643c537e"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "c8afc717eaff5fb5fe59190c4ec91430"
server_key_iv: "9b9ebe8e52c09a5457fb2ee5b8b1d9a5"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.295344 8955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "f7e89bb87ce14b93affb0ece643c537e"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "c8afc717eaff5fb5fe59190c4ec91430"
server_key_iv: "9b9ebe8e52c09a5457fb2ee5b8b1d9a5"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.296895 8955 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:08.297799 8970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.298053 8955 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:08.298175 8955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "f7e89bb87ce14b93affb0ece643c537e"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "c8afc717eaff5fb5fe59190c4ec91430"
server_key_iv: "9b9ebe8e52c09a5457fb2ee5b8b1d9a5"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.298267 8955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:08.310653 8955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:08.312882 8955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:08.313062 8955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:08.313310 8955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:08.313643 8955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:08.313702 8955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.313736 8955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:08.313763 8955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.319396 8955 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:46443
I20260924 17:33:08.319481 9086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:46443 every 8 connection(s)
I20260924 17:33:08.319808 8955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:08.323662 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 8955
I20260924 17:33:08.323760 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:08.323951 6292 external_mini_cluster.cc:1428] Setting key e285ed3dc0d5759fd473332664e33e1a
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[8711](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271188, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:08.329797 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:08.320601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:44361 (local address 127.6.37.62:36265)
0924 17:33:08.320670 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:08.320672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:08.320885 (+ 213us) server_negotiation.cc:407] Connection header received
0924 17:33:08.321427 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:08.321428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:08.321440 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:08.321485 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:08.322458 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.323075 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.324414 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.324686 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.324777 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:08.326992 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:08.326993 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:08.326993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:08.327001 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:08.328375 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.328796 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.328797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.328798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.328857 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.329127 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.329128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.329129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.329249 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:08.329328 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:08.329620 (+ 292us) server_negotiation.cc:299] Negotiation successful
0924 17:33:08.329706 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260924 17:33:08.330008 9089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:08.320577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36265 (local address 127.6.37.2:44361)
0924 17:33:08.320759 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:08.320795 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:08.321299 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:08.321551 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:08.321560 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:08.322137 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:08.322350 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:08.322355 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.323170 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.323171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:08.324330 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:08.324333 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.324788 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.324789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:08.324935 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:08.325499 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:08.325509 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:08.326851 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:08.328479 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:08.328487 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:08.328489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:08.328714 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:08.328933 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:08.328934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:08.328934 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:08.329055 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:08.329318 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:08.329325 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:08.329471 (+ 146us) client_negotiation.cc:769] Sending connection context
0924 17:33:08.329598 (+ 127us) client_negotiation.cc:240] Negotiation successful
0924 17:33:08.329760 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260924 17:33:08.330605 9087 heartbeater.cc:347] Connected to a master server at 127.6.37.62:36265
I20260924 17:33:08.330709 9087 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:08.330961 9087 heartbeater.cc:511] Master 127.6.37.62:36265 requested a full tablet report, sending...
I20260924 17:33:08.331394 8758 ts_manager.cc:194] Registered new tserver with Master: f7e89bb87ce14b93affb0ece643c537e (127.6.37.2:46443)
I20260924 17:33:08.331930 8758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:44361
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:33:08.349979 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36265
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:08.436131 9092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:08.436335 9092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:08.436360 9092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:08.437456 9092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:08.437502 9092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:08.437529 9092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:08.438897 9092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36265
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:08.439102 9092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:08.439282 9092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:08.444355 9098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:08.444380 9100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:08.444404 9097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:08.444439 9092 server_base.cc:1034] running on GCE node
I20260924 17:33:08.444693 9092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:08.444932 9092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:08.446098 9092 hybrid_clock.cc:648] HybridClock initialized: now 1790271188446071 us; error 59 us; skew 500 ppm
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[8711](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271188, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:08.448586 9092 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:33:08.449003 9092 webserver.cc:460] Webserver started at http://127.6.37.3:42241/ using document root <none> and password file <none>
I20260924 17:33:08.449225 9092 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:08.449301 9092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:08.449453 9092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:08.450491 9092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "03114189f6ad4e519a38f89d05e7a324"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "209c4cd86fddb03abc415eeaa35322de"
server_key_iv: "9ea2dbe05d11564a225fc97d8ab3e077"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.450863 9092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "03114189f6ad4e519a38f89d05e7a324"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "209c4cd86fddb03abc415eeaa35322de"
server_key_iv: "9ea2dbe05d11564a225fc97d8ab3e077"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.452239 9092 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:08.452965 9108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.453128 9092 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:08.453228 9092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "03114189f6ad4e519a38f89d05e7a324"
format_stamp: "Formatted at 2026-09-24 17:33:08 on dist-test-slave-gcz9"
server_key: "209c4cd86fddb03abc415eeaa35322de"
server_key_iv: "9ea2dbe05d11564a225fc97d8ab3e077"
server_key_version: "encryptionkey@0"
I20260924 17:33:08.453315 9092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:08.462148 9092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:08.464743 9092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:08.464941 9092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:08.465188 9092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:08.465520 9092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:08.465582 9092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.465627 9092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:08.465653 9092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:08.472182 9092 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:33063
I20260924 17:33:08.472216 9221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:33063 every 8 connection(s)
I20260924 17:33:08.472572 9092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:08.475063 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9092
I20260924 17:33:08.475167 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:08.475353 6292 external_mini_cluster.cc:1428] Setting key 0ab666f245f79a10966b74c0897908f4
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[8711](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271188, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:08.482213 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:08.473298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:60001 (local address 127.6.37.62:36265)
0924 17:33:08.473393 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:08.473396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:08.473587 (+ 191us) server_negotiation.cc:407] Connection header received
0924 17:33:08.474109 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:08.474110 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:08.474124 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:08.474175 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:08.475284 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.476065 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.477216 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.477443 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.477539 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:08.479720 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:08.479721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:08.479722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:08.479728 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:08.481008 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.481382 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.481383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.481383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.481437 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:08.481668 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:08.481669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:08.481669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:08.481776 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:08.481842 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:08.482071 (+ 229us) server_negotiation.cc:299] Negotiation successful
0924 17:33:08.482148 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260924 17:33:08.482333 9224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:08.473264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36265 (local address 127.6.37.3:60001)
0924 17:33:08.473454 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:08.473489 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:08.473993 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:08.474246 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:08.474249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:08.474799 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:08.475145 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:08.475153 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.476153 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.476155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:08.477094 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:08.477097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:08.477551 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:08.477552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:08.477690 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:08.478148 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:08.478156 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:08.479605 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:08.481086 (+ 1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:08.481093 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:08.481094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:08.481300 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:08.481512 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:08.481512 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:08.481512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:08.481607 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:08.481837 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:08.481841 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:08.481950 (+ 109us) client_negotiation.cc:769] Sending connection context
0924 17:33:08.482030 (+ 80us) client_negotiation.cc:240] Negotiation successful
0924 17:33:08.482147 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
I20260924 17:33:08.482867 9222 heartbeater.cc:347] Connected to a master server at 127.6.37.62:36265
I20260924 17:33:08.483006 9222 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:08.483147 9222 heartbeater.cc:511] Master 127.6.37.62:36265 requested a full tablet report, sending...
I20260924 17:33:08.483505 8758 ts_manager.cc:194] Registered new tserver with Master: 03114189f6ad4e519a38f89d05e7a324 (127.6.37.3:33063)
I20260924 17:33:08.483887 8758 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:60001
I20260924 17:33:08.487330 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260924 17:33:08.499738 8797 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:08.498711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50628 (local address 127.6.37.62:36265)
0924 17:33:08.498765 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:08.498768 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:08.498955 (+ 187us) server_negotiation.cc:407] Connection header received
0924 17:33:08.499048 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:08.499050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:08.499060 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:08.499116 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:08.499663 (+ 547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50628: BlockingRecv error: recv got EOF from 127.0.0.1:50628 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:33:08.500650 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8820
I20260924 17:33:08.506490 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8955
I20260924 17:33:08.511133 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9092
I20260924 17:33:08.515633 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 8726
2026-09-24T17:33:08Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1845 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[9235](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[9235](info): set up 2 sockets
Sep 24 17:33:08 dist-test-slave-gcz9 krb5kdc[9235](info): commencing operation
krb5kdc: starting...
W20260924 17:33:09.568694 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:09 dist-test-slave-gcz9 krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:09.689690 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34041
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:09.772162 9249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:09.772399 9249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:09.772435 9249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:09.773569 9249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:09.773644 9249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:09.773670 9249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:09.773697 9249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:09.773717 9249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:09.775213 9249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:09.775480 9249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:09.775693 9249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:09.780536 9255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:09.780551 9257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:09.780551 9254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:09.780777 9249 server_base.cc:1034] running on GCE node
I20260924 17:33:09.781095 9249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:09.781370 9249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:09.782548 9249 hybrid_clock.cc:648] HybridClock initialized: now 1790271189782541 us; error 38 us; skew 500 ppm
Sep 24 17:33:09 dist-test-slave-gcz9 krb5kdc[9235](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271189, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:09.800926 9249 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:09.801424 9249 webserver.cc:460] Webserver started at http://127.6.37.62:38699/ using document root <none> and password file <none>
I20260924 17:33:09.801676 9249 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:09.801750 9249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:09.801918 9249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:09.803139 9249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63"
format_stamp: "Formatted at 2026-09-24 17:33:09 on dist-test-slave-gcz9"
server_key: "2a181937d8cc9d4c5ae8a950bd40dbd2"
server_key_iv: "f530414d153da1141ded69c5eb053b7e"
server_key_version: "encryptionkey@0"
I20260924 17:33:09.803526 9249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63"
format_stamp: "Formatted at 2026-09-24 17:33:09 on dist-test-slave-gcz9"
server_key: "2a181937d8cc9d4c5ae8a950bd40dbd2"
server_key_iv: "f530414d153da1141ded69c5eb053b7e"
server_key_version: "encryptionkey@0"
I20260924 17:33:09.804934 9249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:09.805692 9264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:09.805943 9249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:09.806030 9249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63"
format_stamp: "Formatted at 2026-09-24 17:33:09 on dist-test-slave-gcz9"
server_key: "2a181937d8cc9d4c5ae8a950bd40dbd2"
server_key_iv: "f530414d153da1141ded69c5eb053b7e"
server_key_version: "encryptionkey@0"
I20260924 17:33:09.806083 9249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:09.819212 9249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:09.821051 9249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:09.821162 9249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:09.825162 9249 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34041
I20260924 17:33:09.825194 9316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34041 every 8 connection(s)
I20260924 17:33:09.825555 9249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:09.826417 9317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:09.826964 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9249
I20260924 17:33:09.827071 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:09.827253 6292 external_mini_cluster.cc:1428] Setting key 0032331df2e6b76670c2837a976af1f8
I20260924 17:33:09.829622 9317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63: Bootstrap starting.
I20260924 17:33:09.830309 9317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:09.830600 9317 log.cc:824] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:09.831372 9317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63: No bootstrap required, opened a new log
I20260924 17:33:09.833667 9317 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34041 } }
I20260924 17:33:09.833868 9317 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:09.833905 9317 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1b4e7e8624242d1b5ea20a2c9f6cd63, State: Initialized, Role: FOLLOWER
I20260924 17:33:09.834029 9317 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34041 } }
I20260924 17:33:09.834118 9317 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:09.834156 9317 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:09.834205 9317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 0 FOLLOWER]: Advancing to term 1
Sep 24 17:33:09 dist-test-slave-gcz9 krb5kdc[9235](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271189, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:09.834944 9317 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34041 } }
I20260924 17:33:09.835052 9317 leader_election.cc:302] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1b4e7e8624242d1b5ea20a2c9f6cd63; no voters:
I20260924 17:33:09.835263 9317 leader_election.cc:288] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:09.835299 9322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:09.835427 9322 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [term 1 LEADER]: Becoming Leader. State: Replica: c1b4e7e8624242d1b5ea20a2c9f6cd63, State: Running, Role: LEADER
I20260924 17:33:09.835506 9322 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34041 } }
I20260924 17:33:09.835533 9317 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:09.835850 9322 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34041 } } }
I20260924 17:33:09.835914 9322 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:09.836042 9322 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1b4e7e8624242d1b5ea20a2c9f6cd63. Latest consensus state: current_term: 1 leader_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1b4e7e8624242d1b5ea20a2c9f6cd63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34041 } } }
I20260924 17:33:09.836122 9322 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63 [sys.catalog]: This master's current role is: LEADER
W20260924 17:33:09.838027 9338 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:33:09.838088 9338 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:33:09.838136 9327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:09.838312 9327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:09.839075 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:09.827738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60876 (local address 127.6.37.62:34041)
0924 17:33:09.827994 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:09.828010 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:09.828044 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:33:09.828568 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:09.828578 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:09.828640 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:09.828794 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:09.829418 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:09.830803 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:09.831702 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:09.832313 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:09.832426 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:09.834964 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:09.834968 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:09.834972 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:09.834983 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:09.837369 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:09.837762 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:09.837764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:09.837765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:09.837887 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:09.838124 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:09.838125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:09.838125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:09.838431 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:09.838597 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:09.838696 (+ 99us) server_negotiation.cc:299] Negotiation successful
0924 17:33:09.838848 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":130,"threads_started":1}
I20260924 17:33:09.840142 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:33:09.843320 9327 catalog_manager.cc:1347] Generated new cluster ID: c907efa041384472a82087b4af5f647a
I20260924 17:33:09.843371 9327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:09.853804 9327 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:09.854313 9327 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:09.857538 9327 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1b4e7e8624242d1b5ea20a2c9f6cd63: Generated new TSK 0
I20260924 17:33:09.857702 9327 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:33:09.862653 9320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:09.858714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60878 (local address 127.6.37.62:34041)
0924 17:33:09.858783 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:09.858785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:09.858933 (+ 148us) server_negotiation.cc:407] Connection header received
0924 17:33:09.859014 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:09.859014 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:09.859025 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:09.859077 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:09.859480 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:09.860344 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:09.861135 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:09.861359 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:09.861447 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:09.862187 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:09.862189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:09.862189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:09.862375 (+ 186us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:09.862393 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:09.862399 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:09.862465 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:09.862537 (+ 72us) server_negotiation.cc:299] Negotiation successful
0924 17:33:09.862569 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:33:09.865414 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9249
2026-09-24T17:33:09Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1347 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:09 dist-test-slave-gcz9 krb5kdc[9351](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:09 dist-test-slave-gcz9 krb5kdc[9351](info): set up 2 sockets
Sep 24 17:33:09 dist-test-slave-gcz9 krb5kdc[9351](info): commencing operation
krb5kdc: starting...
W20260924 17:33:10.902740 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:10 dist-test-slave-gcz9 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:11.025468 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:39423
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:39423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:11.122179 9364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:11.122493 9364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:11.122537 9364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:11.124644 9364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:11.124701 9364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:11.124722 9364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:11.124739 9364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:11.124766 9364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:11.126253 9364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:39423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:39423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:11.126451 9364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:11.126614 9364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:11.131582 9372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:11.131794 9364 server_base.cc:1034] running on GCE node
W20260924 17:33:11.131592 9369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.131649 9370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:11.132103 9364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:11.132397 9364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:11.133569 9364 hybrid_clock.cc:648] HybridClock initialized: now 1790271191133556 us; error 49 us; skew 500 ppm
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:11.136041 9364 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:11.136512 9364 webserver.cc:460] Webserver started at http://127.6.37.62:46491/ using document root <none> and password file <none>
I20260924 17:33:11.136746 9364 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:11.136816 9364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:11.136968 9364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:11.137990 9364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "00ce3663bb504b3bb6f80c44122bac67"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "3557040aa13620add09d74a5216418a0"
server_key_iv: "82b9ba4588e6cb0cd2483c08d2e2222e"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.138361 9364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "00ce3663bb504b3bb6f80c44122bac67"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "3557040aa13620add09d74a5216418a0"
server_key_iv: "82b9ba4588e6cb0cd2483c08d2e2222e"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.139762 9364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:11.140534 9380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.140733 9364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:11.140836 9364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "00ce3663bb504b3bb6f80c44122bac67"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "3557040aa13620add09d74a5216418a0"
server_key_iv: "82b9ba4588e6cb0cd2483c08d2e2222e"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.140916 9364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:11.149984 9364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:11.152004 9364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:11.152173 9364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:11.156315 9364 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:39423
I20260924 17:33:11.156369 9432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:39423 every 8 connection(s)
I20260924 17:33:11.156726 9364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:11.157866 9433 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:11.160423 9433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67: Bootstrap starting.
I20260924 17:33:11.160430 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9364
I20260924 17:33:11.160534 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:11.160722 6292 external_mini_cluster.cc:1428] Setting key 1f7d2e208b1c0a87fab75e8f0b4e328a
I20260924 17:33:11.161170 9433 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:11.161548 9433 log.cc:824] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:11.162388 9433 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67: No bootstrap required, opened a new log
I20260924 17:33:11.164700 9433 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ce3663bb504b3bb6f80c44122bac67" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39423 } }
I20260924 17:33:11.164872 9433 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:11.164911 9433 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ce3663bb504b3bb6f80c44122bac67, State: Initialized, Role: FOLLOWER
I20260924 17:33:11.165050 9433 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ce3663bb504b3bb6f80c44122bac67" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39423 } }
I20260924 17:33:11.165158 9433 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:11.165237 9433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:11.165305 9433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:11.165977 9433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ce3663bb504b3bb6f80c44122bac67" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39423 } }
I20260924 17:33:11.166117 9433 leader_election.cc:302] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00ce3663bb504b3bb6f80c44122bac67; no voters:
I20260924 17:33:11.166289 9433 leader_election.cc:288] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:11.166316 9438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:11.166538 9438 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [term 1 LEADER]: Becoming Leader. State: Replica: 00ce3663bb504b3bb6f80c44122bac67, State: Running, Role: LEADER
I20260924 17:33:11.166568 9433 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:11.166671 9438 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ce3663bb504b3bb6f80c44122bac67" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39423 } }
I20260924 17:33:11.167052 9439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00ce3663bb504b3bb6f80c44122bac67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ce3663bb504b3bb6f80c44122bac67" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39423 } } }
I20260924 17:33:11.167040 9438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00ce3663bb504b3bb6f80c44122bac67. Latest consensus state: current_term: 1 leader_uuid: "00ce3663bb504b3bb6f80c44122bac67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00ce3663bb504b3bb6f80c44122bac67" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39423 } } }
I20260924 17:33:11.167132 9439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:11.167140 9438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:11.167343 9445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:11.167835 9445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:11.169366 9445 catalog_manager.cc:1347] Generated new cluster ID: 5e5dcb2a5ba34cdd807f6c59b9c5f57f
I20260924 17:33:11.169423 9445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:11.173014 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.161286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47362 (local address 127.6.37.62:39423)
0924 17:33:11.161478 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:11.161491 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:11.161516 (+ 25us) server_negotiation.cc:407] Connection header received
0924 17:33:11.161990 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:11.161998 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:11.162045 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:11.162159 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:11.163044 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.163902 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.165084 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.165617 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.165705 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.168918 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:11.168922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:11.168922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:11.168935 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:11.171095 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.171496 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.171499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.171500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.171606 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.171809 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.171810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.171810 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.172088 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:11.172233 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:11.172651 (+ 418us) server_negotiation.cc:299] Negotiation successful
0924 17:33:11.172794 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":78,"threads_started":1}
I20260924 17:33:11.200142 9445 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:11.200927 9445 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:11.208977 9445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00ce3663bb504b3bb6f80c44122bac67: Generated new TSK 0
I20260924 17:33:11.209189 9445 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:33:11.238333 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39423
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:11.319036 9459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:11.319233 9459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:11.319257 9459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:11.320477 9459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:11.320523 9459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:11.320580 9459 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:11.322063 9459 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9459
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:11.322316 9459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:11.322584 9459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:11.327661 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.327668 9465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.327678 9467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:11.327911 9459 server_base.cc:1034] running on GCE node
I20260924 17:33:11.328137 9459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:11.328389 9459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:11.329564 9459 hybrid_clock.cc:648] HybridClock initialized: now 1790271191329552 us; error 45 us; skew 500 ppm
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:11.332217 9459 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:33:11.332715 9459 webserver.cc:460] Webserver started at http://127.6.37.1:42751/ using document root <none> and password file <none>
I20260924 17:33:11.332954 9459 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:11.333032 9459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:11.333185 9459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:11.334244 9459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "9df9d210a7004eff917969f2f8c66069"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "9dfb9c8e74adadc2bd5fd6d35cd8e70c"
server_key_iv: "6b67254078022ff2bb5f1e794bd8eada"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.334606 9459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "9df9d210a7004eff917969f2f8c66069"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "9dfb9c8e74adadc2bd5fd6d35cd8e70c"
server_key_iv: "6b67254078022ff2bb5f1e794bd8eada"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.336061 9459 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:33:11.336871 9476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.337049 9459 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:11.337157 9459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "9df9d210a7004eff917969f2f8c66069"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "9dfb9c8e74adadc2bd5fd6d35cd8e70c"
server_key_iv: "6b67254078022ff2bb5f1e794bd8eada"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.337257 9459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:11.349092 9459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:11.351356 9459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:11.351516 9459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:11.351729 9459 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:11.352037 9459 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:11.352094 9459 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.352134 9459 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:11.352165 9459 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.358111 9459 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:35887
I20260924 17:33:11.358229 9590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:35887 every 8 connection(s)
I20260924 17:33:11.358510 9459 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:11.363176 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9459
I20260924 17:33:11.363255 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:11.363451 6292 external_mini_cluster.cc:1428] Setting key b7d1b6a45e8787e89775fcf976f2cd26
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:11.368897 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.359318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:35107 (local address 127.6.37.62:39423)
0924 17:33:11.359367 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:11.359370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:11.359579 (+ 209us) server_negotiation.cc:407] Connection header received
0924 17:33:11.360063 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:11.360065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:11.360077 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:11.360124 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:11.361003 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.361515 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.362497 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.362710 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.362768 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.365297 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:11.365298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:11.365299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:11.365308 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:11.367183 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.367803 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.367804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.367805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.367861 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.368196 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.368196 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.368197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.368302 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:11.368357 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:11.368712 (+ 355us) server_negotiation.cc:299] Negotiation successful
0924 17:33:11.368827 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:11.369171 9593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.359261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:39423 (local address 127.6.37.1:35107)
0924 17:33:11.359420 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:11.359461 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:11.359947 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:11.360177 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:11.360181 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:11.360715 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:11.360898 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:11.360902 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.361604 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.361605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:11.362408 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:11.362410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.362789 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.362790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:11.362909 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.363529 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:11.363540 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:11.365176 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:11.367314 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:11.367323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:11.367326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:11.367675 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:11.367945 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:11.367946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:11.367946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:11.368122 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:11.368380 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:11.368387 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:11.368562 (+ 175us) client_negotiation.cc:769] Sending connection context
0924 17:33:11.368694 (+ 132us) client_negotiation.cc:240] Negotiation successful
0924 17:33:11.368892 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260924 17:33:11.369771 9591 heartbeater.cc:347] Connected to a master server at 127.6.37.62:39423
I20260924 17:33:11.369863 9591 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:11.370051 9591 heartbeater.cc:511] Master 127.6.37.62:39423 requested a full tablet report, sending...
I20260924 17:33:11.370630 9397 ts_manager.cc:194] Registered new tserver with Master: 9df9d210a7004eff917969f2f8c66069 (127.6.37.1:35887)
I20260924 17:33:11.371273 9397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:35107
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:33:11.394757 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39423
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:11.477895 9596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:11.478148 9596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:11.478193 9596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:11.479460 9596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:11.479532 9596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:11.479580 9596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:11.481063 9596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:11.481343 9596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:11.481594 9596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:11.486924 9601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.487011 9602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.486933 9604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:11.487198 9596 server_base.cc:1034] running on GCE node
I20260924 17:33:11.487394 9596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:11.487656 9596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:11.488843 9596 hybrid_clock.cc:648] HybridClock initialized: now 1790271191488846 us; error 52 us; skew 500 ppm
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:11.491417 9596 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:33:11.491845 9596 webserver.cc:460] Webserver started at http://127.6.37.2:34553/ using document root <none> and password file <none>
I20260924 17:33:11.492086 9596 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:11.492156 9596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:11.492298 9596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:11.493305 9596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "d3540c68ed6f4570b5e03418c33f3767"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "8776ff77d0d1c9c3ff3df5aaea3e1f24"
server_key_iv: "68eeca1b8e90f1db4756e0cac81022b3"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.493664 9596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "d3540c68ed6f4570b5e03418c33f3767"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "8776ff77d0d1c9c3ff3df5aaea3e1f24"
server_key_iv: "68eeca1b8e90f1db4756e0cac81022b3"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.494997 9596 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:33:11.495725 9611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.495903 9596 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:11.496006 9596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "d3540c68ed6f4570b5e03418c33f3767"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "8776ff77d0d1c9c3ff3df5aaea3e1f24"
server_key_iv: "68eeca1b8e90f1db4756e0cac81022b3"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.496088 9596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:11.518023 9596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:11.520422 9596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:11.520609 9596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:11.521001 9596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:11.521399 9596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:11.521463 9596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.521500 9596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:11.521528 9596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.528302 9596 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:34033
I20260924 17:33:11.528426 9727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:34033 every 8 connection(s)
I20260924 17:33:11.528743 9596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:11.529495 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9596
I20260924 17:33:11.529635 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:11.529857 6292 external_mini_cluster.cc:1428] Setting key ad5cd55dfafbe3e9d517df80c014350e
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
I20260924 17:33:11.539796 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.529599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:60773 (local address 127.6.37.62:39423)
0924 17:33:11.529652 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:11.529653 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:11.529925 (+ 272us) server_negotiation.cc:407] Connection header received
0924 17:33:11.530556 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:11.530556 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:11.530566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:11.530653 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:11.531670 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.532396 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.533725 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.534105 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.534210 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.536947 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:11.536949 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:11.536950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:11.536957 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:11.538339 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.538774 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.538776 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.538777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.538836 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.539138 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.539139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.539140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.539254 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:11.539329 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:11.539621 (+ 292us) server_negotiation.cc:299] Negotiation successful
0924 17:33:11.539703 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:11.540020 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.529597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:39423 (local address 127.6.37.2:60773)
0924 17:33:11.529788 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:11.529831 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:11.530430 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:11.530727 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:11.530731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:11.531373 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:11.531574 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:11.531579 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.532498 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.532499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:11.533611 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:11.533614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.534246 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.534247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:11.534426 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.535164 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:11.535189 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:11.536833 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:11.538440 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:11.538448 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:11.538451 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:11.538677 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:11.538947 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:11.538948 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:11.538948 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:11.539063 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:11.539334 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:11.539340 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:11.539481 (+ 141us) client_negotiation.cc:769] Sending connection context
0924 17:33:11.539589 (+ 108us) client_negotiation.cc:240] Negotiation successful
0924 17:33:11.539749 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":99,"threads_started":1}
I20260924 17:33:11.540520 9728 heartbeater.cc:347] Connected to a master server at 127.6.37.62:39423
I20260924 17:33:11.540638 9728 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:11.540822 9728 heartbeater.cc:511] Master 127.6.37.62:39423 requested a full tablet report, sending...
I20260924 17:33:11.541257 9397 ts_manager.cc:194] Registered new tserver with Master: d3540c68ed6f4570b5e03418c33f3767 (127.6.37.2:34033)
I20260924 17:33:11.541651 9397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:60773
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:33:11.558233 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39423
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:11.643721 9733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:11.643965 9733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:11.644006 9733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:11.645282 9733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:11.645346 9733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:11.645391 9733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:11.646847 9733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:11.647147 9733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:11.647375 9733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:11.653093 9741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.653067 9739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:11.653155 9738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:11.653475 9733 server_base.cc:1034] running on GCE node
I20260924 17:33:11.653724 9733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:11.653937 9733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:11.655126 9733 hybrid_clock.cc:648] HybridClock initialized: now 1790271191655113 us; error 27 us; skew 500 ppm
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:11.657678 9733 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:33:11.658162 9733 webserver.cc:460] Webserver started at http://127.6.37.3:34979/ using document root <none> and password file <none>
I20260924 17:33:11.658391 9733 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:11.658460 9733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:11.658612 9733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:11.659806 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "2e2e6323f7084620839e5a4052559d82"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "99eba16898a7dae9a0638f38f767ed80"
server_key_iv: "2c99a664db4d8c29c0311c00267c255f"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.660211 9733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "2e2e6323f7084620839e5a4052559d82"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "99eba16898a7dae9a0638f38f767ed80"
server_key_iv: "2c99a664db4d8c29c0311c00267c255f"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.661547 9733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:11.662385 9748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.662602 9733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:11.662712 9733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "2e2e6323f7084620839e5a4052559d82"
format_stamp: "Formatted at 2026-09-24 17:33:11 on dist-test-slave-gcz9"
server_key: "99eba16898a7dae9a0638f38f767ed80"
server_key_iv: "2c99a664db4d8c29c0311c00267c255f"
server_key_version: "encryptionkey@0"
I20260924 17:33:11.662783 9733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:11.676448 9733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:11.678277 9733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:11.678386 9733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:11.678581 9733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:11.678830 9733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:11.678860 9733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.678953 9733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:11.678973 9733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:11.684916 9733 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:35443
I20260924 17:33:11.684998 9864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:35443 every 8 connection(s)
I20260924 17:33:11.685302 9733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:11.693212 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9733
I20260924 17:33:11.693325 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:11.693588 6292 external_mini_cluster.cc:1428] Setting key b3c18b42b28df0c38a49a512dd4dc7aa
I20260924 17:33:11.696511 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.686090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:51293 (local address 127.6.37.62:39423)
0924 17:33:11.686155 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:11.686157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:11.686337 (+ 180us) server_negotiation.cc:407] Connection header received
0924 17:33:11.686817 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:11.686818 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:11.686828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:11.686930 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:11.687952 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.688461 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.689475 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.689710 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.689788 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.692422 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:11.692423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:11.692424 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:11.692432 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:11.694943 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.695389 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.695391 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.695391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.695448 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.695783 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.695784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.695785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.695943 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:11.696034 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:11.696332 (+ 298us) server_negotiation.cc:299] Negotiation successful
0924 17:33:11.696420 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:33:11.696985 9867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.686053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:39423 (local address 127.6.37.3:51293)
0924 17:33:11.686213 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:11.686254 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:11.686735 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:11.687001 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:11.687004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:11.687630 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:11.687826 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:11.687831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.688558 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.688559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:11.689383 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:11.689385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.689808 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.689809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:11.689934 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.690450 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:11.690458 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:11.692305 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:11.695037 (+ 2732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:11.695044 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:11.695046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:11.695289 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:11.695545 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:11.695546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:11.695547 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:11.695693 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:11.696028 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:11.696036 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:11.696194 (+ 158us) client_negotiation.cc:769] Sending connection context
0924 17:33:11.696297 (+ 103us) client_negotiation.cc:240] Negotiation successful
0924 17:33:11.696459 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260924 17:33:11.697507 9865 heartbeater.cc:347] Connected to a master server at 127.6.37.62:39423
I20260924 17:33:11.697609 9865 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:11.697830 9865 heartbeater.cc:511] Master 127.6.37.62:39423 requested a full tablet report, sending...
I20260924 17:33:11.698340 9397 ts_manager.cc:194] Registered new tserver with Master: 2e2e6323f7084620839e5a4052559d82 (127.6.37.3:35443)
I20260924 17:33:11.698927 9397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:51293
I20260924 17:33:11.705256 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9351](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271191, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:11.727519 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:11.720588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47372 (local address 127.6.37.62:39423)
0924 17:33:11.720682 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:11.720684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:11.720696 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:33:11.720767 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:11.720768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:11.720778 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:11.720841 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:11.721389 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.721884 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.722625 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:11.722832 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:11.723002 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:11.725119 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:11.725120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:11.725121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:11.725127 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:11.726534 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.726818 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.726819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.726819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.726913 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:11.727073 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:11.727073 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:11.727073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:11.727210 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:11.727281 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:11.727364 (+ 83us) server_negotiation.cc:299] Negotiation successful
0924 17:33:11.727423 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260924 17:33:11.727761 9397 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47372
I20260924 17:33:11.728246 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9459
I20260924 17:33:11.733615 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9596
I20260924 17:33:11.738154 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9733
I20260924 17:33:11.742933 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9364
2026-09-24T17:33:11Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1879 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9877](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9877](info): set up 2 sockets
Sep 24 17:33:11 dist-test-slave-gcz9 krb5kdc[9877](info): commencing operation
krb5kdc: starting...
W20260924 17:33:12.796548 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:12 dist-test-slave-gcz9 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:12.914136 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46763
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:46763
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:12.993727 9890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:12.993963 9890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:12.994005 9890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:12.995208 9890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:12.995270 9890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:12.995296 9890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:12.995328 9890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:12.995350 9890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:12.996817 9890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:46763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:12.997087 9890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:12.997306 9890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:13.002138 9898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.002138 9900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.002213 9896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:13.002353 9890 server_base.cc:1034] running on GCE node
I20260924 17:33:13.002630 9890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:13.002993 9890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:13.004141 9890 hybrid_clock.cc:648] HybridClock initialized: now 1790271193004117 us; error 38 us; skew 500 ppm
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:13.006747 9890 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:13.007299 9890 webserver.cc:460] Webserver started at http://127.6.37.62:43421/ using document root <none> and password file <none>
I20260924 17:33:13.007529 9890 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:13.007572 9890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:13.007725 9890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:13.008816 9890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "1280cfc354fc49cda03b433f9171213a"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "1c86d6fd5ada771eeb234a2724f2dfa7"
server_key_iv: "bad0ef9630b93e993fec7439bbb688eb"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.009121 9890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "1280cfc354fc49cda03b433f9171213a"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "1c86d6fd5ada771eeb234a2724f2dfa7"
server_key_iv: "bad0ef9630b93e993fec7439bbb688eb"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.010425 9890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:13.011162 9907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.011379 9890 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:13.011472 9890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "1280cfc354fc49cda03b433f9171213a"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "1c86d6fd5ada771eeb234a2724f2dfa7"
server_key_iv: "bad0ef9630b93e993fec7439bbb688eb"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.011528 9890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:13.025177 9890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:13.027516 9890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:13.027626 9890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:13.031877 9890 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:46763
I20260924 17:33:13.031939 9959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:46763 every 8 connection(s)
I20260924 17:33:13.032478 9890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:13.033157 9960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:13.035401 9960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a: Bootstrap starting.
I20260924 17:33:13.035926 9960 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:13.036175 9960 log.cc:824] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:13.036814 9960 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a: No bootstrap required, opened a new log
I20260924 17:33:13.038384 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9890
I20260924 17:33:13.038342 9960 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1280cfc354fc49cda03b433f9171213a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46763 } }
I20260924 17:33:13.038465 9960 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:13.038509 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:13.038486 9960 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1280cfc354fc49cda03b433f9171213a, State: Initialized, Role: FOLLOWER
I20260924 17:33:13.038677 9960 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1280cfc354fc49cda03b433f9171213a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46763 } }
I20260924 17:33:13.038764 6292 external_mini_cluster.cc:1428] Setting key 36acfcd770f05d34c109600d0ed8f58d
I20260924 17:33:13.038755 9960 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:13.038811 9960 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:13.038861 9960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:13.039613 9960 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1280cfc354fc49cda03b433f9171213a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46763 } }
I20260924 17:33:13.039739 9960 leader_election.cc:302] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1280cfc354fc49cda03b433f9171213a; no voters:
I20260924 17:33:13.039908 9960 leader_election.cc:288] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:13.039981 9965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:13.040097 9965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [term 1 LEADER]: Becoming Leader. State: Replica: 1280cfc354fc49cda03b433f9171213a, State: Running, Role: LEADER
I20260924 17:33:13.040186 9960 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:13.040184 9965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1280cfc354fc49cda03b433f9171213a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46763 } }
I20260924 17:33:13.041896 9966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1280cfc354fc49cda03b433f9171213a. Latest consensus state: current_term: 1 leader_uuid: "1280cfc354fc49cda03b433f9171213a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1280cfc354fc49cda03b433f9171213a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46763 } } }
I20260924 17:33:13.042035 9966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:13.041900 9967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1280cfc354fc49cda03b433f9171213a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1280cfc354fc49cda03b433f9171213a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46763 } } }
I20260924 17:33:13.042137 9967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a [sys.catalog]: This master's current role is: LEADER
W20260924 17:33:13.042208 9979 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:33:13.042264 9979 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:33:13.042860 9981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:13.043071 9981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:13.044639 9981 catalog_manager.cc:1347] Generated new cluster ID: cf2ebc6fe6de4697b71bec4b635f3fb1
I20260924 17:33:13.044688 9981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271192, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:13.050669 9981 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:13.050910 9964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.039603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34540 (local address 127.6.37.62:46763)
0924 17:33:13.039783 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:13.039796 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:13.039833 (+ 37us) server_negotiation.cc:407] Connection header received
0924 17:33:13.039961 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:13.039968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:13.040025 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:13.040943 (+ 918us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:13.041074 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.042578 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.043727 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.044339 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.044467 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.047100 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:13.047104 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:13.047104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:13.047116 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:13.049102 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.049471 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.049474 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.049474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.049603 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.049798 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.049799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.049799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.050066 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:13.050213 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:13.050455 (+ 242us) server_negotiation.cc:299] Negotiation successful
0924 17:33:13.050596 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":103,"threads_started":1}
I20260924 17:33:13.051626 9981 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:13.055867 9981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1280cfc354fc49cda03b433f9171213a: Generated new TSK 0
I20260924 17:33:13.056051 9981 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:33:13.091691 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46763
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:13.189492 9986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:13.189759 9986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:13.189798 9986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:13.191010 9986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:13.191071 9986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:13.191114 9986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:13.192591 9986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:13.192863 9986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:13.193095 9986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:13.198833 9992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.198928 9991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.199085 9994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:13.199177 9986 server_base.cc:1034] running on GCE node
I20260924 17:33:13.199391 9986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:13.199657 9986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:13.200827 9986 hybrid_clock.cc:648] HybridClock initialized: now 1790271193200798 us; error 65 us; skew 500 ppm
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:13.203516 9986 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:33:13.203895 9986 webserver.cc:460] Webserver started at http://127.6.37.1:35459/ using document root <none> and password file <none>
I20260924 17:33:13.204069 9986 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:13.204107 9986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:13.204193 9986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:13.205160 9986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "55a0f918d5a146b5b8940f30ba17f81c"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "8f2222b75b069e236634a3e3836a82a6"
server_key_iv: "b7362dfe4b46a95f23035157ed065261"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.205461 9986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "55a0f918d5a146b5b8940f30ba17f81c"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "8f2222b75b069e236634a3e3836a82a6"
server_key_iv: "b7362dfe4b46a95f23035157ed065261"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.206722 9986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:13.207563 10001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.207803 9986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:13.207924 9986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "55a0f918d5a146b5b8940f30ba17f81c"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "8f2222b75b069e236634a3e3836a82a6"
server_key_iv: "b7362dfe4b46a95f23035157ed065261"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.208015 9986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:13.225070 9986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:13.227701 9986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:13.227896 9986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:13.228168 9986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:13.228525 9986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:13.228564 9986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.228617 9986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:13.228649 9986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.235039 9986 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:46291
I20260924 17:33:13.235118 10117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:46291 every 8 connection(s)
I20260924 17:33:13.235492 9986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:13.236790 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 9986
I20260924 17:33:13.236909 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:13.237084 6292 external_mini_cluster.cc:1428] Setting key a508089d712cb4094c1e89c9a940a88c
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
I20260924 17:33:13.246917 9964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.236275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:51553 (local address 127.6.37.62:46763)
0924 17:33:13.236371 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:13.236373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:13.236552 (+ 179us) server_negotiation.cc:407] Connection header received
0924 17:33:13.237696 (+ 1144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:13.237697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:13.237709 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:13.237769 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:13.238487 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.239302 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.240760 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.241125 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.241196 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.243697 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:13.243699 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:13.243700 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:13.243710 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:13.245441 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.245889 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.245891 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.245892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.245958 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.246286 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.246288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.246288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.246427 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:13.246486 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:13.246739 (+ 253us) server_negotiation.cc:299] Negotiation successful
0924 17:33:13.246805 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260924 17:33:13.247186 10120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.236231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46763 (local address 127.6.37.1:51553)
0924 17:33:13.236423 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:13.236460 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:13.237586 (+ 1126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:13.237904 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:13.237908 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:13.238173 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:13.238378 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:13.238382 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.239412 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.239413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:13.240671 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:13.240674 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.241214 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.241215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:13.241334 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.241939 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:13.241951 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:13.243583 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:13.245553 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:13.245560 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:13.245561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:13.245796 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:13.246076 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:13.246077 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:13.246078 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:13.246206 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:13.246498 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:13.246503 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:13.246619 (+ 116us) client_negotiation.cc:769] Sending connection context
0924 17:33:13.246704 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:33:13.246824 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260924 17:33:13.247769 10118 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46763
I20260924 17:33:13.247887 10118 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:13.248086 10118 heartbeater.cc:511] Master 127.6.37.62:46763 requested a full tablet report, sending...
I20260924 17:33:13.248683 9924 ts_manager.cc:194] Registered new tserver with Master: 55a0f918d5a146b5b8940f30ba17f81c (127.6.37.1:46291)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
I20260924 17:33:13.249550 9924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:51553
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:33:13.266615 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46763
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:13.347357 10123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:13.347563 10123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:13.347585 10123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:13.348695 10123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:13.348729 10123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:13.348755 10123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:13.350221 10123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:13.350409 10123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:13.350575 10123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:13.355676 10129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.355676 10131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.355681 10128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:13.355942 10123 server_base.cc:1034] running on GCE node
I20260924 17:33:13.356276 10123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:13.356537 10123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:13.357712 10123 hybrid_clock.cc:648] HybridClock initialized: now 1790271193357694 us; error 46 us; skew 500 ppm
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:13.360324 10123 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:33:13.360785 10123 webserver.cc:460] Webserver started at http://127.6.37.2:39909/ using document root <none> and password file <none>
I20260924 17:33:13.361078 10123 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:13.361152 10123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:13.361306 10123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:13.362392 10123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "44a9ad9e4bce44c5b6deac3a3177a07f"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "449aaa62f8807af71f1418c518a9a68f"
server_key_iv: "fd1d13a50ea3cf86772dc7395cded515"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.362777 10123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "44a9ad9e4bce44c5b6deac3a3177a07f"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "449aaa62f8807af71f1418c518a9a68f"
server_key_iv: "fd1d13a50ea3cf86772dc7395cded515"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.364089 10123 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:13.364816 10138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.364997 10123 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:33:13.365095 10123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "44a9ad9e4bce44c5b6deac3a3177a07f"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "449aaa62f8807af71f1418c518a9a68f"
server_key_iv: "fd1d13a50ea3cf86772dc7395cded515"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.365185 10123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:13.374727 10123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:13.377050 10123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:13.377213 10123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:13.377439 10123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:13.377775 10123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:13.377842 10123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.377888 10123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:13.377915 10123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.383845 10123 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:46295
I20260924 17:33:13.383888 10252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:46295 every 8 connection(s)
I20260924 17:33:13.384195 10123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:13.391538 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10123
I20260924 17:33:13.391623 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:13.391794 6292 external_mini_cluster.cc:1428] Setting key 6eb08048d2aa50dd353e32ef32838ca5
I20260924 17:33:13.393277 9964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.384945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:45235 (local address 127.6.37.62:46763)
0924 17:33:13.385010 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:13.385012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:13.385212 (+ 200us) server_negotiation.cc:407] Connection header received
0924 17:33:13.386153 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:13.386154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:13.386165 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:13.386217 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:13.386797 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.387306 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.388257 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.388436 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.388485 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.390460 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:13.390462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:13.390462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:13.390469 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:13.391779 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.392269 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.392270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.392271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.392332 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.392645 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.392645 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.392646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.392756 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:13.392811 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:13.393145 (+ 334us) server_negotiation.cc:299] Negotiation successful
0924 17:33:13.393214 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260924 17:33:13.393647 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.384881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46763 (local address 127.6.37.2:45235)
0924 17:33:13.385086 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:13.385121 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:13.386057 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:13.386294 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:13.386298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:13.386539 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:13.386721 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:13.386726 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.387383 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.387384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:13.388181 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:13.388183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.388511 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.388512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:13.388612 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.389019 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:13.389027 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:13.390367 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:13.391860 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:13.391868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:13.391870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:13.392195 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:13.392428 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:13.392429 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:13.392430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:13.392583 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:13.392829 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:13.392835 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:13.393003 (+ 168us) client_negotiation.cc:769] Sending connection context
0924 17:33:13.393121 (+ 118us) client_negotiation.cc:240] Negotiation successful
0924 17:33:13.393296 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":88,"threads_started":1}
I20260924 17:33:13.394202 10253 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46763
I20260924 17:33:13.394316 10253 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:13.394490 10253 heartbeater.cc:511] Master 127.6.37.62:46763 requested a full tablet report, sending...
I20260924 17:33:13.394955 9924 ts_manager.cc:194] Registered new tserver with Master: 44a9ad9e4bce44c5b6deac3a3177a07f (127.6.37.2:46295)
I20260924 17:33:13.395455 9924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:45235
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:33:13.418849 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46763
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:13.499747 10258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:13.499987 10258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:13.500025 10258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:13.501168 10258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:13.501236 10258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:13.501283 10258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:13.502763 10258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:13.503057 10258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:13.503288 10258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:13.508359 10263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.508327 10264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:13.508337 10266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:13.508617 10258 server_base.cc:1034] running on GCE node
I20260924 17:33:13.508847 10258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:13.509100 10258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:13.510269 10258 hybrid_clock.cc:648] HybridClock initialized: now 1790271193510263 us; error 34 us; skew 500 ppm
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:13.512836 10258 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:33:13.513262 10258 webserver.cc:460] Webserver started at http://127.6.37.3:37541/ using document root <none> and password file <none>
I20260924 17:33:13.513505 10258 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:13.513573 10258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:13.513705 10258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:13.514768 10258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "34af825210e941a9a21154978723c673"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "bcae814cb790c80103169eec2a8bdf74"
server_key_iv: "b7af82e8c90ebe7c6c4b86ef17dd97f6"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.515205 10258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "34af825210e941a9a21154978723c673"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "bcae814cb790c80103169eec2a8bdf74"
server_key_iv: "b7af82e8c90ebe7c6c4b86ef17dd97f6"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.516534 10258 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:13.517254 10273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.517431 10258 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:13.517532 10258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "34af825210e941a9a21154978723c673"
format_stamp: "Formatted at 2026-09-24 17:33:13 on dist-test-slave-gcz9"
server_key: "bcae814cb790c80103169eec2a8bdf74"
server_key_iv: "b7af82e8c90ebe7c6c4b86ef17dd97f6"
server_key_version: "encryptionkey@0"
I20260924 17:33:13.517613 10258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:13.528725 10258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:13.530566 10258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:13.530725 10258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:13.531023 10258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:13.531358 10258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:13.531391 10258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.531414 10258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:13.531466 10258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:13.536931 10258 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:41651
I20260924 17:33:13.536984 10387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:41651 every 8 connection(s)
I20260924 17:33:13.537297 10258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:13.543442 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10258
I20260924 17:33:13.543561 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:13.543849 6292 external_mini_cluster.cc:1428] Setting key 9684ab669dbae22b293cb4c600a1f55e
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:13.547603 9964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.538035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:34593 (local address 127.6.37.62:46763)
0924 17:33:13.538118 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:13.538121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:13.538320 (+ 199us) server_negotiation.cc:407] Connection header received
0924 17:33:13.539300 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:13.539301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:13.539312 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:13.539364 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:13.539913 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.540467 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.541649 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.541980 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.542040 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.545111 (+ 3071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:13.545112 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:13.545112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:13.545118 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:13.546287 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.546661 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.546662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.546662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.546713 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.546978 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.546979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.546980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.547088 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:13.547143 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:13.547470 (+ 327us) server_negotiation.cc:299] Negotiation successful
0924 17:33:13.547540 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260924 17:33:13.547869 10390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.537985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46763 (local address 127.6.37.3:34593)
0924 17:33:13.538193 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:13.538227 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:13.539210 (+ 983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:13.539417 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:13.539420 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:13.539662 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:13.539845 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:13.539849 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.540574 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.540575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:13.541559 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:13.541562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.542095 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.542096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:13.542224 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.542904 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:13.542917 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:13.545023 (+ 2106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:13.546362 (+ 1339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:13.546369 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:13.546370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:13.546591 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:13.546754 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:13.546754 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:13.546754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:13.546852 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:13.547181 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:13.547188 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:13.547334 (+ 146us) client_negotiation.cc:769] Sending connection context
0924 17:33:13.547433 (+ 99us) client_negotiation.cc:240] Negotiation successful
0924 17:33:13.547573 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":110,"threads_started":1}
I20260924 17:33:13.548460 10388 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46763
I20260924 17:33:13.548591 10388 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:13.548806 10388 heartbeater.cc:511] Master 127.6.37.62:46763 requested a full tablet report, sending...
I20260924 17:33:13.549242 9924 ts_manager.cc:194] Registered new tserver with Master: 34af825210e941a9a21154978723c673 (127.6.37.3:41651)
I20260924 17:33:13.549592 9924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:34593
I20260924 17:33:13.555714 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:33:13.578570 10395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.571208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41490 (local address 127.6.37.1:46291)
0924 17:33:13.571368 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:13.571378 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:13.571388 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:13.571415 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:13.571417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:13.571430 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:13.571513 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:13.572110 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.572800 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.573544 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.573856 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.573908 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.576089 (+ 2181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:13.576098 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:13.576099 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:13.576105 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:13.577542 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.577912 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.577915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.577916 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.577968 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.578137 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.578137 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.578137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.578259 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:13.578357 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:13.578427 (+ 70us) server_negotiation.cc:299] Negotiation successful
0924 17:33:13.578485 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[9877](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271193, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:13.586645 9964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:13.580008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34552 (local address 127.6.37.62:46763)
0924 17:33:13.580077 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:13.580078 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:13.580086 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:13.580125 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:13.580126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:13.580134 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:13.580178 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:13.580584 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.581060 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.581686 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:13.581859 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:13.581905 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:13.584464 (+ 2559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:13.584465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:13.584465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:13.584471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:13.585738 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.586048 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.586049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.586049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.586091 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:13.586251 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:13.586251 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:13.586251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:13.586371 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:13.586436 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:13.586529 (+ 93us) server_negotiation.cc:299] Negotiation successful
0924 17:33:13.586585 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260924 17:33:13.586926 9924 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34552
I20260924 17:33:13.587278 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9986
I20260924 17:33:13.592655 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10123
I20260924 17:33:13.597206 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10258
I20260924 17:33:13.601653 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 9890
2026-09-24T17:33:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1858 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[10400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[10400](info): set up 2 sockets
Sep 24 17:33:13 dist-test-slave-gcz9 krb5kdc[10400](info): commencing operation
krb5kdc: starting...
W20260924 17:33:14.664729 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:14 dist-test-slave-gcz9 krb5kdc[10400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:14.786096 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46475
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:46475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:14.866846 10414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:14.867063 10414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:14.867089 10414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:14.868249 10414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:14.868295 10414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:14.868309 10414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:14.868376 10414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:14.868397 10414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:14.869925 10414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:46475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:14.870190 10414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:14.870440 10414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:14.875180 10420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:14.875159 10423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:14.875164 10421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:14.875180 10414 server_base.cc:1034] running on GCE node
I20260924 17:33:14.875726 10414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:14.875967 10414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:14.877110 10414 hybrid_clock.cc:648] HybridClock initialized: now 1790271194877099 us; error 31 us; skew 500 ppm
Sep 24 17:33:14 dist-test-slave-gcz9 krb5kdc[10400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271194, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:14.888861 10414 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:14.889230 10414 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:14.889276 10414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:14.889374 10414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:14.890511 10414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "83287f27df694aa8823e3edcea5fd692"
format_stamp: "Formatted at 2026-09-24 17:33:14 on dist-test-slave-gcz9"
server_key: "a7fe8749d22e7b259475a77f1c88ecd5"
server_key_iv: "5339f2c57f05a565fc14230c053a5511"
server_key_version: "encryptionkey@0"
I20260924 17:33:14.890815 10414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "83287f27df694aa8823e3edcea5fd692"
format_stamp: "Formatted at 2026-09-24 17:33:14 on dist-test-slave-gcz9"
server_key: "a7fe8749d22e7b259475a77f1c88ecd5"
server_key_iv: "5339f2c57f05a565fc14230c053a5511"
server_key_version: "encryptionkey@0"
I20260924 17:33:14.892172 10414 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:14.892925 10429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:14.893164 10414 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:14.893242 10414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "83287f27df694aa8823e3edcea5fd692"
format_stamp: "Formatted at 2026-09-24 17:33:14 on dist-test-slave-gcz9"
server_key: "a7fe8749d22e7b259475a77f1c88ecd5"
server_key_iv: "5339f2c57f05a565fc14230c053a5511"
server_key_version: "encryptionkey@0"
I20260924 17:33:14.893294 10414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:14.904870 10414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:14.906620 10414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:14.906724 10414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:14.910658 10414 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:46475
I20260924 17:33:14.910719 10481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:46475 every 8 connection(s)
I20260924 17:33:14.911070 10414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:14.912092 10482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:14.914395 10482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692: Bootstrap starting.
I20260924 17:33:14.915072 10482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:14.915382 10482 log.cc:824] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:14.916038 10482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692: No bootstrap required, opened a new log
I20260924 17:33:14.917598 10482 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83287f27df694aa8823e3edcea5fd692" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46475 } }
I20260924 17:33:14.917737 10482 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:14.917759 10482 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83287f27df694aa8823e3edcea5fd692, State: Initialized, Role: FOLLOWER
I20260924 17:33:14.917918 10482 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83287f27df694aa8823e3edcea5fd692" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46475 } }
I20260924 17:33:14.918002 10482 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:14.918025 10482 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:14.918099 10482 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:14.918970 10482 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83287f27df694aa8823e3edcea5fd692" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46475 } }
I20260924 17:33:14.919080 10482 leader_election.cc:302] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83287f27df694aa8823e3edcea5fd692; no voters:
I20260924 17:33:14.919286 10482 leader_election.cc:288] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:14.919368 10485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:14.919538 10485 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [term 1 LEADER]: Becoming Leader. State: Replica: 83287f27df694aa8823e3edcea5fd692, State: Running, Role: LEADER
I20260924 17:33:14.919567 10482 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:14.919723 10485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83287f27df694aa8823e3edcea5fd692" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46475 } }
I20260924 17:33:14.920085 10487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83287f27df694aa8823e3edcea5fd692. Latest consensus state: current_term: 1 leader_uuid: "83287f27df694aa8823e3edcea5fd692" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83287f27df694aa8823e3edcea5fd692" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46475 } } }
I20260924 17:33:14.920081 10486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83287f27df694aa8823e3edcea5fd692" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83287f27df694aa8823e3edcea5fd692" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46475 } } }
I20260924 17:33:14.920194 10487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:14.920199 10486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:14.920642 10492 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:14.920974 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10414
I20260924 17:33:14.921077 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:14.921159 10492 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:14.921277 6292 external_mini_cluster.cc:1428] Setting key 8dd4ad63f804510fbe5f8d5536a2c6ff
I20260924 17:33:14.923038 10492 catalog_manager.cc:1347] Generated new cluster ID: 3799247da9794927b6b50ce1a424cd92
I20260924 17:33:14.923099 10492 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:33:14 dist-test-slave-gcz9 krb5kdc[10400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271194, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:14.946133 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:14.921723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52026 (local address 127.6.37.62:46475)
0924 17:33:14.935007 (+ 13284us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:14.935019 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:14.935066 (+ 47us) server_negotiation.cc:407] Connection header received
0924 17:33:14.935205 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:14.935213 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:14.935271 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:14.935433 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:14.936325 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:14.937813 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:14.938902 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:14.939569 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:14.939686 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:14.942458 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:14.942462 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:14.942463 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:14.942475 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:14.944435 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:14.944840 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:14.944843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:14.944844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:14.944960 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:14.945188 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:14.945189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:14.945189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:14.945494 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:14.945634 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:14.945768 (+ 134us) server_negotiation.cc:299] Negotiation successful
0924 17:33:14.945901 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13220,"thread_start_us":78,"threads_started":1}
I20260924 17:33:14.952013 10492 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:14.952737 10492 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:14.959434 10492 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692: Generated new TSK 0
I20260924 17:33:14.959617 10492 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:33:14.989977 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46475
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:15.070994 10509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:15.071211 10509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:15.071249 10509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:15.072402 10509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:15.072474 10509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:15.072520 10509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:15.073982 10509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:15.074247 10509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:15.074476 10509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:15.079434 10515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:15.079433 10514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.079609 10509 server_base.cc:1034] running on GCE node
W20260924 17:33:15.079515 10517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.079882 10509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:15.080122 10509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:15.081321 10509 hybrid_clock.cc:648] HybridClock initialized: now 1790271195081304 us; error 44 us; skew 500 ppm
Sep 24 17:33:15 dist-test-slave-gcz9 krb5kdc[10400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271195, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:15.084069 10509 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:33:15.084434 10509 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:15.084519 10509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:15.084682 10509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:15.085780 10509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "d7007c2cd4404c2fafd32f18dbb212ad"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "dbbedfe2cbaff3f3e6a20154f9d8eb2a"
server_key_iv: "d94efd2a601e5de93ef1a539211b6635"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.086170 10509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "d7007c2cd4404c2fafd32f18dbb212ad"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "dbbedfe2cbaff3f3e6a20154f9d8eb2a"
server_key_iv: "d94efd2a601e5de93ef1a539211b6635"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.087703 10509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260924 17:33:15.088512 10523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.088689 10509 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:15.088843 10509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "d7007c2cd4404c2fafd32f18dbb212ad"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "dbbedfe2cbaff3f3e6a20154f9d8eb2a"
server_key_iv: "d94efd2a601e5de93ef1a539211b6635"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.088930 10509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:15.097734 10509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:15.099607 10509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:15.099789 10509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:15.100028 10509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:15.100364 10509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:15.100427 10509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.100473 10509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:15.100507 10509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.107025 10509 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:41365
I20260924 17:33:15.107056 10636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:41365 every 8 connection(s)
I20260924 17:33:15.107331 10509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:33:15 dist-test-slave-gcz9 krb5kdc[10400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271195, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:15.115072 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10509
I20260924 17:33:15.115195 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:15.115396 6292 external_mini_cluster.cc:1428] Setting key f194f5c8e185d9d9cc882b7ed3f2c100
I20260924 17:33:15.117343 10640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.108109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46475 (local address 127.6.37.1:37689)
0924 17:33:15.108288 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.108321 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.108808 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.109048 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.109052 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.109309 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:15.109810 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.109815 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.110531 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.110533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.111772 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.111774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.112177 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.112178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.112310 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.112809 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:15.112817 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:15.114200 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:15.116031 (+ 1831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:15.116039 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:15.116041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:15.116293 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:15.116503 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:15.116504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:15.116504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:15.116599 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:15.116874 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:15.116879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:15.116985 (+ 106us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.117074 (+ 89us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.117188 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":88,"threads_started":1}
I20260924 17:33:15.117381 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.108117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:37689 (local address 127.6.37.62:46475)
0924 17:33:15.108166 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.108168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.108405 (+ 237us) server_negotiation.cc:407] Connection header received
0924 17:33:15.108917 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.108918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.108929 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.108983 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:15.109918 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.110428 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.111857 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.112078 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.112166 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.114303 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:15.114305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:15.114305 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:15.114312 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:15.115931 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.116376 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.116377 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.116378 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.116436 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.116664 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.116665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.116665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.116812 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:15.116880 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.117125 (+ 245us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.117232 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:15.118052 10637 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46475
I20260924 17:33:15.118158 10637 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:15.118317 10637 heartbeater.cc:511] Master 127.6.37.62:46475 requested a full tablet report, sending...
I20260924 17:33:15.118849 10446 ts_manager.cc:194] Registered new tserver with Master: d7007c2cd4404c2fafd32f18dbb212ad (127.6.37.1:41365)
I20260924 17:33:15.119486 10446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:37689
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:33:15.141417 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46475
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:15.224785 10643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:15.224985 10643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:15.225009 10643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:15.226172 10643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:15.226214 10643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:15.226270 10643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:15.227783 10643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:15.228046 10643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:15.228286 10643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:15.233387 10649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:15.233409 10651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:15.233409 10648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.233619 10643 server_base.cc:1034] running on GCE node
I20260924 17:33:15.233861 10643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:15.234102 10643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:15.235267 10643 hybrid_clock.cc:648] HybridClock initialized: now 1790271195235255 us; error 45 us; skew 500 ppm
Sep 24 17:33:15 dist-test-slave-gcz9 krb5kdc[10400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271195, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:15.237797 10643 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:33:15.238135 10643 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:15.238212 10643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:15.238364 10643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:15.239468 10643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "84f35cca4aad4606992d20cc9c5f51f4"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "d780abee0d9a8ae636d5e07255f3adb3"
server_key_iv: "0153fd4bb6a560a37583410f9b58cc48"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.239835 10643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "84f35cca4aad4606992d20cc9c5f51f4"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "d780abee0d9a8ae636d5e07255f3adb3"
server_key_iv: "0153fd4bb6a560a37583410f9b58cc48"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.241098 10643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:15.241786 10658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.241971 10643 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:15.242081 10643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "84f35cca4aad4606992d20cc9c5f51f4"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "d780abee0d9a8ae636d5e07255f3adb3"
server_key_iv: "0153fd4bb6a560a37583410f9b58cc48"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.242158 10643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:15.252720 10643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:15.255062 10643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:15.255210 10643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:15.255422 10643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:15.255730 10643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:15.255785 10643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.255824 10643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:15.255851 10643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.261771 10643 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:40635
I20260924 17:33:15.261899 10772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:40635 every 8 connection(s)
I20260924 17:33:15.262102 10643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:15.266369 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10643
I20260924 17:33:15.266479 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:15.266665 6292 external_mini_cluster.cc:1428] Setting key fdaa81c427b0a0cc1cffca587fd98799
Sep 24 17:33:15 dist-test-slave-gcz9 krb5kdc[10400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271195, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:15.271711 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.262880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:45559 (local address 127.6.37.62:46475)
0924 17:33:15.263028 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.263030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.263181 (+ 151us) server_negotiation.cc:407] Connection header received
0924 17:33:15.263647 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.263648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.263658 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.263710 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:15.264598 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.265099 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.266061 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.266342 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.266419 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.268783 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:15.268785 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:15.268785 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:15.268793 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:15.270187 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.270678 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.270679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.270679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.270732 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.271079 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.271080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.271080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.271185 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:15.271242 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.271579 (+ 337us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.271649 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260924 17:33:15.271992 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.262824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46475 (local address 127.6.37.2:45559)
0924 17:33:15.263057 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.263096 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.263565 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.263767 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.263771 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.264009 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:15.264520 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.264526 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.265181 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.265182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.265981 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.265984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.266467 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.266468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.266611 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.267152 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:15.267162 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:15.268681 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:15.270273 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:15.270281 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:15.270283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:15.270595 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:15.270818 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:15.270819 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:15.270820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:15.270996 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:15.271261 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:15.271269 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:15.271433 (+ 164us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.271544 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.271719 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":133,"threads_started":1}
I20260924 17:33:15.272445 10773 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46475
I20260924 17:33:15.272558 10773 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:15.272714 10773 heartbeater.cc:511] Master 127.6.37.62:46475 requested a full tablet report, sending...
I20260924 17:33:15.273159 10446 ts_manager.cc:194] Registered new tserver with Master: 84f35cca4aad4606992d20cc9c5f51f4 (127.6.37.2:40635)
I20260924 17:33:15.273543 10446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:45559
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:33:15.294219 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46475
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:15.375142 10778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:15.375335 10778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:15.375360 10778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:15.376437 10778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:15.376472 10778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:15.376498 10778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:15.377928 10778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:15.378111 10778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:15.378278 10778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:15.383180 10787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.383356 10778 server_base.cc:1034] running on GCE node
W20260924 17:33:15.383167 10784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:15.383155 10785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.383689 10778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:15.383875 10778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:15.385022 10778 hybrid_clock.cc:648] HybridClock initialized: now 1790271195385014 us; error 30 us; skew 500 ppm
Sep 24 17:33:15 dist-test-slave-gcz9 krb5kdc[10400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271195, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:15.387594 10778 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:33:15.387964 10778 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:15.388012 10778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:15.388101 10778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:15.389053 10778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "75f9f61e83864d9f817d5854556cb86d"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "1ee42e263ffadb393bb95cf84d455c6a"
server_key_iv: "e821fd8d627ba0f7b3bdbfa61f45c967"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.389431 10778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "75f9f61e83864d9f817d5854556cb86d"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "1ee42e263ffadb393bb95cf84d455c6a"
server_key_iv: "e821fd8d627ba0f7b3bdbfa61f45c967"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.390640 10778 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:15.391443 10793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.391647 10778 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.391746 10778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "75f9f61e83864d9f817d5854556cb86d"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "1ee42e263ffadb393bb95cf84d455c6a"
server_key_iv: "e821fd8d627ba0f7b3bdbfa61f45c967"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.391815 10778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:15.399781 10778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:15.401984 10778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:15.402086 10778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:15.402243 10778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:15.402503 10778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:15.402532 10778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.402552 10778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:15.402565 10778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.408438 10778 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38805
I20260924 17:33:15.408480 10906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38805 every 8 connection(s)
I20260924 17:33:15.408731 10778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:15.409075 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10778
I20260924 17:33:15.409188 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:15.409406 6292 external_mini_cluster.cc:1428] Setting key 34ce040c15d0f113119376d2676f7640
Sep 24 17:33:15 dist-test-slave-gcz9 krb5kdc[10400](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271195, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:15.418092 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.409434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:40215 (local address 127.6.37.62:46475)
0924 17:33:15.409478 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.409480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.409746 (+ 266us) server_negotiation.cc:407] Connection header received
0924 17:33:15.410361 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.410363 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.410378 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.410425 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:15.411436 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.411936 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.412949 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.413141 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.413217 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.415304 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:15.415306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:15.415306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:15.415312 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:15.416667 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.417153 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.417153 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.417154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.417203 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.417472 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.417472 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.417473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.417573 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:15.417625 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.417958 (+ 333us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.418028 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:33:15.418365 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.409429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46475 (local address 127.6.37.3:40215)
0924 17:33:15.409632 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.409680 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.410260 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.410496 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.410500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.410776 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:15.411337 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.411342 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.412034 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.412035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.412828 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.412830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.413236 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.413237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.413357 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.413785 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:15.413793 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:15.415218 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:15.416767 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:15.416774 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:15.416776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:15.417075 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:15.417284 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:15.417285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:15.417285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:15.417399 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:15.417664 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:15.417670 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:15.417791 (+ 121us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.417932 (+ 141us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.418057 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":111,"threads_started":1}
I20260924 17:33:15.418960 10907 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46475
I20260924 17:33:15.419045 10907 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:15.419159 10907 heartbeater.cc:511] Master 127.6.37.62:46475 requested a full tablet report, sending...
I20260924 17:33:15.419586 10446 ts_manager.cc:194] Registered new tserver with Master: 75f9f61e83864d9f817d5854556cb86d (127.6.37.3:38805)
I20260924 17:33:15.419988 10446 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:40215
I20260924 17:33:15.421514 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:33:15.429016 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.422941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52036 (local address 127.6.37.62:46475)
0924 17:33:15.423000 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.423002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.423045 (+ 43us) server_negotiation.cc:407] Connection header received
0924 17:33:15.423096 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.423097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.423104 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.423157 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:15.423750 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.424309 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.425011 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.425209 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.425264 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.426321 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:15.426322 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:15.426322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:15.426330 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:15.428007 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.428321 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.428323 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.428323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.428378 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:15.428550 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:15.428550 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:15.428551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:15.428681 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:15.428756 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.428834 (+ 78us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.428892 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:33:15.430572 10446 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52036:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:15.432224 10446 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:15.439093 10915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.434519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40635 (local address 127.0.0.1:34474)
0924 17:33:15.435126 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.435135 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.435184 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.435424 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.435427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.435431 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:15.435520 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.435522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.436633 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.436635 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.437877 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.437880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.438715 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.438716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.438805 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.438828 (+ 23us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.438952 (+ 124us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.439011 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260924 17:33:15.439105 10918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.434721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.6.37.2:40635)
0924 17:33:15.434917 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.434922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.435198 (+ 276us) server_negotiation.cc:407] Connection header received
0924 17:33:15.435244 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.435246 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.435268 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.435413 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:15.435609 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.436533 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.437979 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.438609 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.438711 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.438777 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.438974 (+ 197us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.439027 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260924 17:33:15.439335 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.434533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38805 (local address 127.0.0.1:54968)
0924 17:33:15.435674 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.435683 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.435728 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.435943 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.435944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.435946 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:15.435983 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.435984 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.437199 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.437200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.438197 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.438200 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.439120 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.439121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.439169 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.439172 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.439221 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.439251 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1129,"mutex_wait_us":1,"thread_start_us":65,"threads_started":1}
I20260924 17:33:15.439407 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.434979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54968 (local address 127.6.37.3:38805)
0924 17:33:15.435156 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.435159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.435785 (+ 626us) server_negotiation.cc:407] Connection header received
0924 17:33:15.435831 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.435834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.435849 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.435922 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:15.436067 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.437096 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.438290 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.438987 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.439044 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.439092 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.439262 (+ 170us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.439316 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260924 17:33:15.439455 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.434776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.6.37.1:41365)
0924 17:33:15.435274 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.435278 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.435286 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:15.435318 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.435320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.435331 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.435425 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:15.435749 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.436902 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.438165 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.438919 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.438992 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.439054 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.439309 (+ 255us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.439358 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":79,"threads_started":1}
I20260924 17:33:15.439539 10916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.434518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:41365 (local address 127.0.0.1:36314)
0924 17:33:15.434689 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.434731 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.434798 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.435518 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.435519 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.435522 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:15.435578 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.435579 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.437014 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.437015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.438083 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.438085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.439091 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.439092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.439155 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.439159 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.439211 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.439251 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":39,"thread_start_us":57,"threads_started":1}
I20260924 17:33:15.440171 10841 tablet_service.cc:1467] Processing CreateTablet for tablet 55c2ef726f2b430281d9f9f1d8502552 (DEFAULT_TABLE table=test-table [id=1cd719e79be5476fba3a4316a3cc4e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:15.440429 10571 tablet_service.cc:1467] Processing CreateTablet for tablet 55c2ef726f2b430281d9f9f1d8502552 (DEFAULT_TABLE table=test-table [id=1cd719e79be5476fba3a4316a3cc4e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:15.440573 10841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c2ef726f2b430281d9f9f1d8502552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:15.440791 10571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c2ef726f2b430281d9f9f1d8502552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:15.441102 10706 tablet_service.cc:1467] Processing CreateTablet for tablet 55c2ef726f2b430281d9f9f1d8502552 (DEFAULT_TABLE table=test-table [id=1cd719e79be5476fba3a4316a3cc4e83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:15.441414 10706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c2ef726f2b430281d9f9f1d8502552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:15.443708 10921 tablet_bootstrap.cc:492] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: Bootstrap starting.
I20260924 17:33:15.444056 10922 tablet_bootstrap.cc:492] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Bootstrap starting.
I20260924 17:33:15.444633 10921 tablet_bootstrap.cc:654] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:15.444717 10922 tablet_bootstrap.cc:654] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:15.444737 10923 tablet_bootstrap.cc:492] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Bootstrap starting.
I20260924 17:33:15.445326 10923 tablet_bootstrap.cc:654] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:15.445513 10922 log.cc:824] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:15.445568 10921 log.cc:824] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:15.445973 10923 log.cc:824] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:15.446382 10922 tablet_bootstrap.cc:492] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: No bootstrap required, opened a new log
I20260924 17:33:15.446491 10922 ts_tablet_manager.cc:1397] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:33:15.446692 10923 tablet_bootstrap.cc:492] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: No bootstrap required, opened a new log
I20260924 17:33:15.446760 10921 tablet_bootstrap.cc:492] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: No bootstrap required, opened a new log
I20260924 17:33:15.446777 10923 ts_tablet_manager.cc:1397] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:33:15.446847 10921 ts_tablet_manager.cc:1397] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:33:15.448132 10923 raft_consensus.cc:348] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.448297 10923 raft_consensus.cc:374] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:15.448343 10923 raft_consensus.cc:729] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84f35cca4aad4606992d20cc9c5f51f4, State: Initialized, Role: FOLLOWER
I20260924 17:33:15.448453 10923 consensus_queue.cc:260] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.448597 10922 raft_consensus.cc:348] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.448734 10923 ts_tablet_manager.cc:1428] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:33:15.448773 10922 raft_consensus.cc:374] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:15.448813 10922 raft_consensus.cc:729] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f9f61e83864d9f817d5854556cb86d, State: Initialized, Role: FOLLOWER
I20260924 17:33:15.448874 10773 heartbeater.cc:503] Master 127.6.37.62:46475 was elected leader, sending a full tablet report...
I20260924 17:33:15.448930 10922 consensus_queue.cc:260] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.449005 10921 raft_consensus.cc:348] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.449215 10922 ts_tablet_manager.cc:1428] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:33:15.449258 10921 raft_consensus.cc:374] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:15.449301 10921 raft_consensus.cc:729] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7007c2cd4404c2fafd32f18dbb212ad, State: Initialized, Role: FOLLOWER
I20260924 17:33:15.449343 10907 heartbeater.cc:503] Master 127.6.37.62:46475 was elected leader, sending a full tablet report...
I20260924 17:33:15.449427 10921 consensus_queue.cc:260] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.449730 10921 ts_tablet_manager.cc:1428] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:33:15.449935 10637 heartbeater.cc:503] Master 127.6.37.62:46475 was elected leader, sending a full tablet report...
W20260924 17:33:15.512639 10774 tablet.cc:2369] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:33:15.608198 10638 tablet.cc:2369] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:33:15.659264 10908 tablet.cc:2369] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:33:15.710297 10929 raft_consensus.cc:482] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:15.710459 10929 raft_consensus.cc:504] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.710843 10929 leader_election.cc:288] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84f35cca4aad4606992d20cc9c5f51f4 (127.6.37.2:40635), 75f9f61e83864d9f817d5854556cb86d (127.6.37.3:38805)
I20260924 17:33:15.715020 10918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.711169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:39225 (local address 127.6.37.2:40635)
0924 17:33:15.711215 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.711217 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.711323 (+ 106us) server_negotiation.cc:407] Connection header received
0924 17:33:15.711391 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.711392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.711405 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.711483 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:15.711710 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.712455 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.714041 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.714612 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.714689 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.714699 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.714908 (+ 209us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.714955 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:15.715034 10931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.711084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38805 (local address 127.6.37.1:53515)
0924 17:33:15.711234 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.711247 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.711327 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.711511 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.711512 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.711515 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:15.711636 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.711637 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.712557 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.712558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.713941 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.713944 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.714711 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.714713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.714840 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.714844 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.714923 (+ 79us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.714951 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":116,"thread_start_us":84,"threads_started":1}
I20260924 17:33:15.715072 10920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.711137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:53515 (local address 127.6.37.3:38805)
0924 17:33:15.711190 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.711192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.711323 (+ 131us) server_negotiation.cc:407] Connection header received
0924 17:33:15.711404 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.711405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.711416 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.711483 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:15.711709 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.712455 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.714040 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.714612 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.714689 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.714699 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.714948 (+ 249us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.714988 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:15.715037 10930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.711084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40635 (local address 127.6.37.1:39225)
0924 17:33:15.711235 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.711247 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:15.711327 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:15.711511 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:15.711512 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:15.711517 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:15.711613 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.711615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.712557 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.712558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.713940 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:15.713944 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.714712 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.714713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:15.714787 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.714793 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:33:15.714856 (+ 63us) client_negotiation.cc:240] Negotiation successful
0924 17:33:15.714930 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":55,"thread_start_us":78,"threads_started":1}
I20260924 17:33:15.715502 10861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c2ef726f2b430281d9f9f1d8502552" candidate_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f9f61e83864d9f817d5854556cb86d" is_pre_election: true
I20260924 17:33:15.715670 10861 raft_consensus.cc:2454] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7007c2cd4404c2fafd32f18dbb212ad in term 0.
I20260924 17:33:15.715708 10726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c2ef726f2b430281d9f9f1d8502552" candidate_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84f35cca4aad4606992d20cc9c5f51f4" is_pre_election: true
I20260924 17:33:15.715863 10726 raft_consensus.cc:2454] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7007c2cd4404c2fafd32f18dbb212ad in term 0.
I20260924 17:33:15.715900 10524 leader_election.cc:302] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75f9f61e83864d9f817d5854556cb86d, d7007c2cd4404c2fafd32f18dbb212ad; no voters:
I20260924 17:33:15.716019 10929 raft_consensus.cc:2781] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:15.716089 10929 raft_consensus.cc:482] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:15.716114 10929 raft_consensus.cc:3037] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:15.716781 10929 raft_consensus.cc:504] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.716931 10929 leader_election.cc:288] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [CANDIDATE]: Term 1 election: Requested vote from peers 84f35cca4aad4606992d20cc9c5f51f4 (127.6.37.2:40635), 75f9f61e83864d9f817d5854556cb86d (127.6.37.3:38805)
I20260924 17:33:15.717097 10726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c2ef726f2b430281d9f9f1d8502552" candidate_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84f35cca4aad4606992d20cc9c5f51f4"
I20260924 17:33:15.717137 10861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c2ef726f2b430281d9f9f1d8502552" candidate_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75f9f61e83864d9f817d5854556cb86d"
I20260924 17:33:15.717183 10726 raft_consensus.cc:3037] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:15.717207 10861 raft_consensus.cc:3037] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:15.718076 10861 raft_consensus.cc:2454] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7007c2cd4404c2fafd32f18dbb212ad in term 1.
I20260924 17:33:15.718075 10726 raft_consensus.cc:2454] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7007c2cd4404c2fafd32f18dbb212ad in term 1.
I20260924 17:33:15.718313 10524 leader_election.cc:302] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75f9f61e83864d9f817d5854556cb86d, d7007c2cd4404c2fafd32f18dbb212ad; no voters:
I20260924 17:33:15.718420 10929 raft_consensus.cc:2781] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:15.718597 10929 raft_consensus.cc:686] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 1 LEADER]: Becoming Leader. State: Replica: d7007c2cd4404c2fafd32f18dbb212ad, State: Running, Role: LEADER
I20260924 17:33:15.718686 10929 consensus_queue.cc:237] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } }
I20260924 17:33:15.719614 10445 catalog_manager.cc:5495] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad reported cstate change: term changed from 0 to 1, leader changed from <none> to d7007c2cd4404c2fafd32f18dbb212ad (127.6.37.1). New cstate: current_term: 1 leader_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7007c2cd4404c2fafd32f18dbb212ad" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 41365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:15.795166 10919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.792387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.6.37.1:41365)
0924 17:33:15.792452 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.792454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.792464 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:15.792511 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.792511 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.792532 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.792598 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:15.792786 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.793635 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.794420 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:15.794609 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:15.794661 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:15.794802 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:15.794929 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:15.794990 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.795050 (+ 60us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.795067 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:33:15.797062 10861 raft_consensus.cc:1261] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 1 FOLLOWER]: Refusing update from remote peer d7007c2cd4404c2fafd32f18dbb212ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:15.797132 10726 raft_consensus.cc:1261] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 1 FOLLOWER]: Refusing update from remote peer d7007c2cd4404c2fafd32f18dbb212ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:15.797394 10929 consensus_queue.cc:1035] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "75f9f61e83864d9f817d5854556cb86d" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:15.797544 10932 consensus_queue.cc:1035] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "84f35cca4aad4606992d20cc9c5f51f4" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:15.799693 10935 mvcc.cc:205] Tried to move back new op lower bound from 7332950817982013440 to 7332950817664520192. Current Snapshot: MvccSnapshot[applied={T|T < 7332950817982013440}]
I20260924 17:33:15.799862 10936 mvcc.cc:205] Tried to move back new op lower bound from 7332950817982013440 to 7332950817664520192. Current Snapshot: MvccSnapshot[applied={T|T < 7332950817982013440}]
I20260924 17:33:15.800804 10937 mvcc.cc:205] Tried to move back new op lower bound from 7332950817982013440 to 7332950817664520192. Current Snapshot: MvccSnapshot[applied={T|T < 7332950817982013440 or (T in {7332950817982013440})}]
I20260924 17:33:15.802269 10446 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:15.802351 10446 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52036:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:15.803180 10446 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83287f27df694aa8823e3edcea5fd692: Sending DeleteTablet for 3 replicas of tablet 55c2ef726f2b430281d9f9f1d8502552
I20260924 17:33:15.803509 10571 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c2ef726f2b430281d9f9f1d8502552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:15 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:36314
I20260924 17:33:15.803524 10841 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c2ef726f2b430281d9f9f1d8502552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:15 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:54968
I20260924 17:33:15.803539 10706 tablet_service.cc:1514] Processing DeleteTablet for tablet 55c2ef726f2b430281d9f9f1d8502552 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:15 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:34474
I20260924 17:33:15.803776 10946 tablet_replica.cc:330] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad: stopping tablet replica
I20260924 17:33:15.803864 10947 tablet_replica.cc:330] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: stopping tablet replica
I20260924 17:33:15.803901 10946 raft_consensus.cc:2229] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:15.803961 10947 raft_consensus.cc:2229] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:15.804028 10946 raft_consensus.cc:2258] T 55c2ef726f2b430281d9f9f1d8502552 P d7007c2cd4404c2fafd32f18dbb212ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:15.804044 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10509
I20260924 17:33:15.804085 10947 raft_consensus.cc:2258] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:15.804713 10945 tablet_replica.cc:330] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: stopping tablet replica
I20260924 17:33:15.804987 10945 raft_consensus.cc:2229] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:15.805088 10945 raft_consensus.cc:2258] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:15.805099 10947 ts_tablet_manager.cc:1905] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:15.805501 10945 ts_tablet_manager.cc:1905] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:15.807595 10947 ts_tablet_manager.cc:1918] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:15.807672 10947 log.cc:1196] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/55c2ef726f2b430281d9f9f1d8502552
I20260924 17:33:15.807924 10947 ts_tablet_manager.cc:1939] T 55c2ef726f2b430281d9f9f1d8502552 P 84f35cca4aad4606992d20cc9c5f51f4: Deleting consensus metadata
I20260924 17:33:15.808085 10945 ts_tablet_manager.cc:1918] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:15.808172 10945 log.cc:1196] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/55c2ef726f2b430281d9f9f1d8502552
I20260924 17:33:15.808441 10945 ts_tablet_manager.cc:1939] T 55c2ef726f2b430281d9f9f1d8502552 P 75f9f61e83864d9f817d5854556cb86d: Deleting consensus metadata
I20260924 17:33:15.808490 10432 catalog_manager.cc:4841] TS 84f35cca4aad4606992d20cc9c5f51f4 (127.6.37.2:40635): tablet 55c2ef726f2b430281d9f9f1d8502552 (table test-table [id=1cd719e79be5476fba3a4316a3cc4e83]) successfully deleted
I20260924 17:33:15.808871 10430 catalog_manager.cc:4841] TS 75f9f61e83864d9f817d5854556cb86d (127.6.37.3:38805): tablet 55c2ef726f2b430281d9f9f1d8502552 (table test-table [id=1cd719e79be5476fba3a4316a3cc4e83]) successfully deleted
W20260924 17:33:15.810861 10433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:41365 (error 108)
I20260924 17:33:15.811164 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10643
I20260924 17:33:15.812081 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.811279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:41365 (local address 127.0.0.1:36338)
0924 17:33:15.812019 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:15.812055 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:41365: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":722}
W20260924 17:33:15.812251 10433 catalog_manager.cc:4584] TS d7007c2cd4404c2fafd32f18dbb212ad (127.6.37.1:41365): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 55c2ef726f2b430281d9f9f1d8502552: Network error: Client connection negotiation failed: client connection to 127.6.37.1:41365: connect: Connection refused (error 111)
I20260924 17:33:15.817900 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10778
I20260924 17:33:15.822721 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10414
2026-09-24T17:33:15Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2221 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-24T17:33:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:15Z Disabled control of system clock
I20260924 17:33:15.849962 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33221
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:46677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:33221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260924 17:33:15.930855 10953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:15.931123 10953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:15.931145 10953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:15.932308 10953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:15.932349 10953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:15.932363 10953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:15.932374 10953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:15.932386 10953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:15.933832 10953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:33221
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:15.934088 10953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:15.934397 10953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:15.939436 10958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:15.939512 10959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.939551 10953 server_base.cc:1034] running on GCE node
W20260924 17:33:15.939505 10961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:15.939942 10953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:15.940232 10953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:15.941407 10953 hybrid_clock.cc:648] HybridClock initialized: now 1790271195941390 us; error 44 us; skew 500 ppm
I20260924 17:33:15.942610 10953 webserver.cc:460] Webserver started at http://127.6.37.62:36873/ using document root <none> and password file <none>
I20260924 17:33:15.942847 10953 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:15.942991 10953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:15.943152 10953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:15.944263 10953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "263bf31ff2b042bda5eb40c4b69232dd"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "2d6ecd3092205dc3b125303385abc251"
server_key_iv: "716a30b9ffce208cd3b1eedf6575dba9"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.944638 10953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "263bf31ff2b042bda5eb40c4b69232dd"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "2d6ecd3092205dc3b125303385abc251"
server_key_iv: "716a30b9ffce208cd3b1eedf6575dba9"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.945973 10953 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:15.946713 10967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:15.946961 10953 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:15.947064 10953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "263bf31ff2b042bda5eb40c4b69232dd"
format_stamp: "Formatted at 2026-09-24 17:33:15 on dist-test-slave-gcz9"
server_key: "2d6ecd3092205dc3b125303385abc251"
server_key_iv: "716a30b9ffce208cd3b1eedf6575dba9"
server_key_version: "encryptionkey@0"
I20260924 17:33:15.947152 10953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:15.950423 10953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:15.950708 10953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:15.950856 10953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:15.954758 10953 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:33221
I20260924 17:33:15.954787 11019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:33221 every 8 connection(s)
I20260924 17:33:15.955180 10953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:15.955850 11020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:15.958568 11020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd: Bootstrap starting.
I20260924 17:33:15.959175 11020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:15.959416 11020 log.cc:824] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:15.960065 11020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd: No bootstrap required, opened a new log
I20260924 17:33:15.961566 11020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263bf31ff2b042bda5eb40c4b69232dd" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33221 } }
I20260924 17:33:15.961696 11020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:15.961719 11020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263bf31ff2b042bda5eb40c4b69232dd, State: Initialized, Role: FOLLOWER
I20260924 17:33:15.961824 11020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263bf31ff2b042bda5eb40c4b69232dd" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33221 } }
I20260924 17:33:15.961910 11020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:15.961947 11020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:15.961997 11020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:15.962505 11020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263bf31ff2b042bda5eb40c4b69232dd" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33221 } }
I20260924 17:33:15.962630 11020 leader_election.cc:302] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 263bf31ff2b042bda5eb40c4b69232dd; no voters:
I20260924 17:33:15.962828 11020 leader_election.cc:288] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:15.962911 11023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:15.963061 11023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [term 1 LEADER]: Becoming Leader. State: Replica: 263bf31ff2b042bda5eb40c4b69232dd, State: Running, Role: LEADER
I20260924 17:33:15.963104 11020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:15.963173 11023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263bf31ff2b042bda5eb40c4b69232dd" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33221 } }
I20260924 17:33:15.963605 11024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "263bf31ff2b042bda5eb40c4b69232dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263bf31ff2b042bda5eb40c4b69232dd" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33221 } } }
I20260924 17:33:15.963766 11024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:15.963972 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 10953
I20260924 17:33:15.964092 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:15.964308 6292 external_mini_cluster.cc:1428] Setting key 0744e71ab80a77e99b0f1a19af81e87b
I20260924 17:33:15.964301 11032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:15.964632 11025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 263bf31ff2b042bda5eb40c4b69232dd. Latest consensus state: current_term: 1 leader_uuid: "263bf31ff2b042bda5eb40c4b69232dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263bf31ff2b042bda5eb40c4b69232dd" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33221 } } }
I20260924 17:33:15.964802 11032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:15.965018 11025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:15.966812 11043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:15.964837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36648 (local address 127.6.37.62:33221)
0924 17:33:15.965046 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:15.965057 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:15.965087 (+ 30us) server_negotiation.cc:407] Connection header received
0924 17:33:15.965202 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:15.965209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:15.965254 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:15.965405 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:15.966265 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:15.966269 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:15.966269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:15.966274 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:15.966325 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:15.966339 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:15.966398 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:15.966489 (+ 91us) server_negotiation.cc:299] Negotiation successful
0924 17:33:15.966633 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":108,"threads_started":1}
I20260924 17:33:15.971273 11032 catalog_manager.cc:1347] Generated new cluster ID: cd239c7f18e04169b108171c40eabe07
I20260924 17:33:15.971342 11032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:15.983042 11032 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:15.983213 11032 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:15.990072 11032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd: Generated new TSK 0
I20260924 17:33:15.990247 11032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:33:15.996973 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33221
--builtin_ntp_servers=127.6.37.20:46677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260924 17:33:16.077463 11045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:16.077657 11045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:16.077679 11045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:16.078819 11045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:16.078859 11045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:16.078974 11045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:16.080335 11045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:16.080588 11045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:16.080894 11045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:16.085877 11051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.085863 11050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.085866 11053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:16.086148 11045 server_base.cc:1034] running on GCE node
I20260924 17:33:16.086375 11045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:16.086642 11045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:16.087826 11045 hybrid_clock.cc:648] HybridClock initialized: now 1790271196087790 us; error 45 us; skew 500 ppm
I20260924 17:33:16.089426 11045 webserver.cc:460] Webserver started at http://127.6.37.1:35839/ using document root <none> and password file <none>
I20260924 17:33:16.089731 11045 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:16.089807 11045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:16.089958 11045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:16.091387 11045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "06d0d7c6aec6471bb09c54b381c0eb0c"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "f6ac7ab7a59d8c2d531cb95c86153fae"
server_key_iv: "6d0344046d1f11518aad2edec8395659"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.091794 11045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "06d0d7c6aec6471bb09c54b381c0eb0c"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "f6ac7ab7a59d8c2d531cb95c86153fae"
server_key_iv: "6d0344046d1f11518aad2edec8395659"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.093472 11045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:16.094293 11059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.094498 11045 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:16.094587 11045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "06d0d7c6aec6471bb09c54b381c0eb0c"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "f6ac7ab7a59d8c2d531cb95c86153fae"
server_key_iv: "6d0344046d1f11518aad2edec8395659"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.094657 11045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:16.099316 11045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:16.099606 11045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:16.099732 11045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:16.099938 11045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:16.100274 11045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:16.100332 11045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.100361 11045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:16.100390 11045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.106235 11045 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:45881
I20260924 17:33:16.106284 11172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:45881 every 8 connection(s)
I20260924 17:33:16.106606 11045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:16.109601 11043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.107351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:49111 (local address 127.6.37.62:33221)
0924 17:33:16.107427 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.107429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.107694 (+ 265us) server_negotiation.cc:407] Connection header received
0924 17:33:16.108139 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.108140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.108154 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.108212 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.109301 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.109302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.109302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.109307 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.109323 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.109327 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.109388 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.109497 (+ 109us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.109516 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260924 17:33:16.109890 11175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.107359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33221 (local address 127.6.37.1:49111)
0924 17:33:16.107568 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.107599 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.108035 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.108281 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.108284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.108293 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.109138 (+ 845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.109139 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.109165 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.109192 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.109390 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.109392 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.109395 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.109514 (+ 119us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.109590 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260924 17:33:16.110387 11173 heartbeater.cc:347] Connected to a master server at 127.6.37.62:33221
I20260924 17:33:16.110460 11173 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:16.110634 11173 heartbeater.cc:511] Master 127.6.37.62:33221 requested a full tablet report, sending...
I20260924 17:33:16.111195 10984 ts_manager.cc:194] Registered new tserver with Master: 06d0d7c6aec6471bb09c54b381c0eb0c (127.6.37.1:45881)
I20260924 17:33:16.111852 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11045
I20260924 17:33:16.111975 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:16.112166 6292 external_mini_cluster.cc:1428] Setting key dc86509d8fb7a60779369376ac3f1584
I20260924 17:33:16.113013 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33221
--builtin_ntp_servers=127.6.37.20:46677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260924 17:33:16.192690 11176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:16.192879 11176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:16.192901 11176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:16.193979 11176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:16.194015 11176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:16.194039 11176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:16.195359 11176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:16.195528 11176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:16.195744 11176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:16.200663 11182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.200631 11181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.200673 11184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:16.200965 11176 server_base.cc:1034] running on GCE node
I20260924 17:33:16.201189 11176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:16.201426 11176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:16.202580 11176 hybrid_clock.cc:648] HybridClock initialized: now 1790271196202568 us; error 28 us; skew 500 ppm
I20260924 17:33:16.203863 11176 webserver.cc:460] Webserver started at http://127.6.37.2:44015/ using document root <none> and password file <none>
I20260924 17:33:16.204066 11176 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:16.204107 11176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:16.204201 11176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:16.205224 11176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "e9873d8627c848bdb1c4b67e00f3c428"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "49dbbb344300c920cb95566376e03628"
server_key_iv: "61996f503d5ba9b75a1ba50282f15559"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.205538 11176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "e9873d8627c848bdb1c4b67e00f3c428"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "49dbbb344300c920cb95566376e03628"
server_key_iv: "61996f503d5ba9b75a1ba50282f15559"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.206753 11176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:16.207566 11191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.207760 11176 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:16.207887 11176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "e9873d8627c848bdb1c4b67e00f3c428"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "49dbbb344300c920cb95566376e03628"
server_key_iv: "61996f503d5ba9b75a1ba50282f15559"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.207957 11176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:16.211480 11176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:16.211722 11176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:16.211856 11176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:16.212085 11176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:16.212381 11176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:16.212414 11176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.212469 11176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:16.212496 11176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.218070 11176 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:40513
I20260924 17:33:16.218148 11304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:40513 every 8 connection(s)
I20260924 17:33:16.218467 11176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:16.221487 11043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.219221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:43147 (local address 127.6.37.62:33221)
0924 17:33:16.219302 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.219304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.219540 (+ 236us) server_negotiation.cc:407] Connection header received
0924 17:33:16.220081 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.220082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.220089 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.220156 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.221224 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.221226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.221226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.221231 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.221248 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.221252 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.221308 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.221401 (+ 93us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.221417 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260924 17:33:16.221668 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.219226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33221 (local address 127.6.37.2:43147)
0924 17:33:16.219421 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.219453 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.219948 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.220231 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.220234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.220242 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.221075 (+ 833us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.221076 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.221102 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.221128 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.221308 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.221313 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.221317 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.221411 (+ 94us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.221470 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
I20260924 17:33:16.222128 11305 heartbeater.cc:347] Connected to a master server at 127.6.37.62:33221
I20260924 17:33:16.222241 11305 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:16.222404 11305 heartbeater.cc:511] Master 127.6.37.62:33221 requested a full tablet report, sending...
I20260924 17:33:16.222852 10984 ts_manager.cc:194] Registered new tserver with Master: e9873d8627c848bdb1c4b67e00f3c428 (127.6.37.2:40513)
I20260924 17:33:16.227291 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11176
I20260924 17:33:16.227391 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:16.227523 6292 external_mini_cluster.cc:1428] Setting key 63f1911e692ae30ae1bf7c495cca1c02
I20260924 17:33:16.228482 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33221
--builtin_ntp_servers=127.6.37.20:46677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260924 17:33:16.309197 11308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:16.309430 11308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:16.309470 11308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:16.311004 11308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:16.311064 11308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:16.311108 11308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:16.312529 11308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:33221
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:16.312793 11308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:16.313108 11308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:16.318114 11314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.318141 11316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.318154 11313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:16.318462 11308 server_base.cc:1034] running on GCE node
I20260924 17:33:16.318696 11308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:16.318984 11308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:16.320129 11308 hybrid_clock.cc:648] HybridClock initialized: now 1790271196320108 us; error 37 us; skew 500 ppm
I20260924 17:33:16.321286 11308 webserver.cc:460] Webserver started at http://127.6.37.3:38899/ using document root <none> and password file <none>
I20260924 17:33:16.321568 11308 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:16.321615 11308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:16.321768 11308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:16.323235 11308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "7045cc7cdaec429caabfca48cda82f71"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "f62c5ccc6d17fabb1675a8bca2948f01"
server_key_iv: "038e24d55f78514913b78627267a62a4"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.323719 11308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "7045cc7cdaec429caabfca48cda82f71"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "f62c5ccc6d17fabb1675a8bca2948f01"
server_key_iv: "038e24d55f78514913b78627267a62a4"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.325098 11308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:16.325959 11322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.326181 11308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:16.326285 11308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "7045cc7cdaec429caabfca48cda82f71"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "f62c5ccc6d17fabb1675a8bca2948f01"
server_key_iv: "038e24d55f78514913b78627267a62a4"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.326365 11308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:16.329852 11308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:16.330123 11308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:16.330269 11308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:16.330473 11308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:16.330792 11308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:16.330884 11308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.330933 11308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:16.330960 11308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.337332 11308 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:41811
I20260924 17:33:16.337365 11436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:41811 every 8 connection(s)
I20260924 17:33:16.337762 11308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:16.340785 11043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.338574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:33907 (local address 127.6.37.62:33221)
0924 17:33:16.338667 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.338669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.338960 (+ 291us) server_negotiation.cc:407] Connection header received
0924 17:33:16.339442 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.339444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.339449 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.339515 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.340592 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.340593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.340593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.340597 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.340612 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.340616 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.340659 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.340720 (+ 61us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.340733 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260924 17:33:16.340979 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.338533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33221 (local address 127.6.37.3:33907)
0924 17:33:16.338735 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.338768 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.339351 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.339569 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.339572 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.339580 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.340451 (+ 871us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.340452 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.340479 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.340506 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.340664 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.340666 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.340668 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.340718 (+ 50us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.340763 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260924 17:33:16.341455 11437 heartbeater.cc:347] Connected to a master server at 127.6.37.62:33221
I20260924 17:33:16.341540 11437 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:16.341646 11437 heartbeater.cc:511] Master 127.6.37.62:33221 requested a full tablet report, sending...
I20260924 17:33:16.341979 10984 ts_manager.cc:194] Registered new tserver with Master: 7045cc7cdaec429caabfca48cda82f71 (127.6.37.3:41811)
I20260924 17:33:16.343097 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11308
I20260924 17:33:16.343210 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:16.343376 6292 external_mini_cluster.cc:1428] Setting key dc0676e6473dd0913c5f829688bea52b
I20260924 17:33:16.344240 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:33:16.346454 11043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.345536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.6.37.62:33221)
0924 17:33:16.345603 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.345605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.345671 (+ 66us) server_negotiation.cc:407] Connection header received
0924 17:33:16.345725 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.345725 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.345729 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.345773 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.346230 (+ 457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.346231 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.346231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.346235 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.346247 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.346250 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.346293 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.346350 (+ 57us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.346361 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260924 17:33:16.348120 10984 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:16.349864 10984 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:16.353719 11448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.352181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:41811 (local address 127.0.0.1:35042)
0924 17:33:16.352525 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.352535 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.352587 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.352743 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.352749 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.352755 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.353230 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.353230 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.353246 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.353268 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.353533 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.353538 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.353541 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.353626 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.353639 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":4,"thread_start_us":90,"threads_started":1}
I20260924 17:33:16.353752 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.352283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35042 (local address 127.6.37.3:41811)
0924 17:33:16.352541 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.352545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.352585 (+ 40us) server_negotiation.cc:407] Connection header received
0924 17:33:16.352638 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.352640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.352650 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.352733 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.353366 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.353373 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.353374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.353378 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.353412 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.353437 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.353475 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.353638 (+ 163us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.353653 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":91,"threads_started":1}
I20260924 17:33:16.354174 11446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.352396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45881 (local address 127.0.0.1:55972)
0924 17:33:16.352728 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.352739 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.352787 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.353336 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.353337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.353339 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.353807 (+ 468us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.353808 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.353816 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.353831 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.354047 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.354048 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.354049 (+ 1us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.354100 (+ 51us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.354113 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":72,"threads_started":1}
I20260924 17:33:16.354447 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.352501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55972 (local address 127.6.37.1:45881)
0924 17:33:16.352701 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.352705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.352801 (+ 96us) server_negotiation.cc:407] Connection header received
0924 17:33:16.352953 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.352959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.352971 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.353053 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.353899 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.353907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.353907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.353911 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.353945 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.353971 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.354035 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.354322 (+ 287us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.354340 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":95,"threads_started":1}
I20260924 17:33:16.354626 11371 tablet_service.cc:1467] Processing CreateTablet for tablet 10afe4dc262745d8b5a386fe72c91a41 (DEFAULT_TABLE table=test-table [id=53217cf9ddb144619118c3cb443405f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:16.354820 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.352181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40513 (local address 127.0.0.1:59294)
0924 17:33:16.352301 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.352342 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.352401 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.353914 (+ 1513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.353915 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.353917 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.354333 (+ 416us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.354334 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.354340 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.354352 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.354633 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.354634 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.354635 (+ 1us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.354705 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.354717 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":70,"threads_started":1}
I20260924 17:33:16.354830 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.352545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59294 (local address 127.6.37.2:40513)
0924 17:33:16.353360 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.353363 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.353371 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:16.353393 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.353395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.353401 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.354094 (+ 693us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.354524 (+ 430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.354528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.354528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.354531 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.354563 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.354578 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.354639 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.354714 (+ 75us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.354745 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":80,"threads_started":1}
I20260924 17:33:16.355280 11107 tablet_service.cc:1467] Processing CreateTablet for tablet 10afe4dc262745d8b5a386fe72c91a41 (DEFAULT_TABLE table=test-table [id=53217cf9ddb144619118c3cb443405f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:16.355423 11239 tablet_service.cc:1467] Processing CreateTablet for tablet 10afe4dc262745d8b5a386fe72c91a41 (DEFAULT_TABLE table=test-table [id=53217cf9ddb144619118c3cb443405f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:16.355542 11107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10afe4dc262745d8b5a386fe72c91a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:16.355671 11239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10afe4dc262745d8b5a386fe72c91a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:16.358171 11452 tablet_bootstrap.cc:492] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Bootstrap starting.
I20260924 17:33:16.358213 11451 tablet_bootstrap.cc:492] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: Bootstrap starting.
I20260924 17:33:16.358759 11371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10afe4dc262745d8b5a386fe72c91a41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:16.358850 11452 tablet_bootstrap.cc:654] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:16.358855 11451 tablet_bootstrap.cc:654] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:16.359165 11451 log.cc:824] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:16.359189 11452 log.cc:824] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:16.359977 11451 tablet_bootstrap.cc:492] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: No bootstrap required, opened a new log
I20260924 17:33:16.360046 11451 ts_tablet_manager.cc:1397] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260924 17:33:16.362052 11455 tablet_bootstrap.cc:492] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Bootstrap starting.
I20260924 17:33:16.362601 11455 tablet_bootstrap.cc:654] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:16.362644 11451 raft_consensus.cc:348] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.362828 11451 raft_consensus.cc:374] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:16.362854 11451 raft_consensus.cc:729] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06d0d7c6aec6471bb09c54b381c0eb0c, State: Initialized, Role: FOLLOWER
I20260924 17:33:16.363013 11455 log.cc:824] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:16.363008 11451 consensus_queue.cc:260] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.363287 11451 ts_tablet_manager.cc:1428] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260924 17:33:16.363291 11173 heartbeater.cc:503] Master 127.6.37.62:33221 was elected leader, sending a full tablet report...
I20260924 17:33:16.364015 11455 tablet_bootstrap.cc:492] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: No bootstrap required, opened a new log
I20260924 17:33:16.364107 11455 ts_tablet_manager.cc:1397] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:16.364377 11452 tablet_bootstrap.cc:492] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: No bootstrap required, opened a new log
I20260924 17:33:16.364450 11452 ts_tablet_manager.cc:1397] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260924 17:33:16.366261 11452 raft_consensus.cc:348] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.366427 11452 raft_consensus.cc:374] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:16.366478 11452 raft_consensus.cc:729] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9873d8627c848bdb1c4b67e00f3c428, State: Initialized, Role: FOLLOWER
I20260924 17:33:16.366595 11452 consensus_queue.cc:260] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.366915 11452 ts_tablet_manager.cc:1428] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 17:33:16.366942 11305 heartbeater.cc:503] Master 127.6.37.62:33221 was elected leader, sending a full tablet report...
I20260924 17:33:16.368777 11455 raft_consensus.cc:348] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.368925 11455 raft_consensus.cc:374] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:16.368971 11455 raft_consensus.cc:729] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7045cc7cdaec429caabfca48cda82f71, State: Initialized, Role: FOLLOWER
I20260924 17:33:16.369089 11455 consensus_queue.cc:260] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.369354 11455 ts_tablet_manager.cc:1428] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260924 17:33:16.369423 11437 heartbeater.cc:503] Master 127.6.37.62:33221 was elected leader, sending a full tablet report...
W20260924 17:33:16.469035 11306 tablet.cc:2369] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:33:16.545473 11456 raft_consensus.cc:482] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:16.545647 11456 raft_consensus.cc:504] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.546101 11456 leader_election.cc:288] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9873d8627c848bdb1c4b67e00f3c428 (127.6.37.2:40513), 7045cc7cdaec429caabfca48cda82f71 (127.6.37.3:41811)
I20260924 17:33:16.547504 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.546367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:57533 (local address 127.6.37.2:40513)
0924 17:33:16.546424 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.546427 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.546442 (+ 15us) server_negotiation.cc:407] Connection header received
0924 17:33:16.546474 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.546475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.546481 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.546571 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.547258 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.547260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.547260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.547264 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.547281 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.547285 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.547365 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.547422 (+ 57us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.547436 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:16.547503 11175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.546296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40513 (local address 127.6.37.1:57533)
0924 17:33:16.546346 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.546357 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.546404 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.546581 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.546582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.546585 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.547153 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.547153 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.547161 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.547173 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.547365 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.547365 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.547367 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.547421 (+ 54us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.547436 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260924 17:33:16.547734 11460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.546300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:41811 (local address 127.6.37.1:58303)
0924 17:33:16.546620 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.546632 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.546684 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.546826 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.546827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.546829 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:16.547338 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:33:16.547339 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:16.547348 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:33:16.547366 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:16.547600 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:16.547600 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:16.547601 (+ 1us) client_negotiation.cc:769] Sending connection context
0924 17:33:16.547647 (+ 46us) client_negotiation.cc:240] Negotiation successful
0924 17:33:16.547657 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":158,"thread_start_us":106,"threads_started":1}
I20260924 17:33:16.547752 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.546396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:58303 (local address 127.6.37.3:41811)
0924 17:33:16.546456 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.546458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.546702 (+ 244us) server_negotiation.cc:407] Connection header received
0924 17:33:16.546732 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.546733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.546739 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.546802 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.547460 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.547462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.547462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.547467 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.547483 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.547487 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.547598 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.547651 (+ 53us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.547668 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260924 17:33:16.547950 11259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10afe4dc262745d8b5a386fe72c91a41" candidate_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9873d8627c848bdb1c4b67e00f3c428" is_pre_election: true
I20260924 17:33:16.548099 11391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10afe4dc262745d8b5a386fe72c91a41" candidate_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7045cc7cdaec429caabfca48cda82f71" is_pre_election: true
I20260924 17:33:16.548147 11259 raft_consensus.cc:2454] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06d0d7c6aec6471bb09c54b381c0eb0c in term 0.
I20260924 17:33:16.548250 11391 raft_consensus.cc:2454] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06d0d7c6aec6471bb09c54b381c0eb0c in term 0.
I20260924 17:33:16.548475 11060 leader_election.cc:302] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06d0d7c6aec6471bb09c54b381c0eb0c, 7045cc7cdaec429caabfca48cda82f71; no voters:
I20260924 17:33:16.548626 11456 raft_consensus.cc:2781] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:16.548707 11456 raft_consensus.cc:482] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:16.548725 11456 raft_consensus.cc:3037] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:16.549471 11456 raft_consensus.cc:504] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.549646 11456 leader_election.cc:288] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [CANDIDATE]: Term 1 election: Requested vote from peers e9873d8627c848bdb1c4b67e00f3c428 (127.6.37.2:40513), 7045cc7cdaec429caabfca48cda82f71 (127.6.37.3:41811)
I20260924 17:33:16.549777 11259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10afe4dc262745d8b5a386fe72c91a41" candidate_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9873d8627c848bdb1c4b67e00f3c428"
I20260924 17:33:16.549847 11391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10afe4dc262745d8b5a386fe72c91a41" candidate_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7045cc7cdaec429caabfca48cda82f71"
I20260924 17:33:16.549860 11259 raft_consensus.cc:3037] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:16.549918 11391 raft_consensus.cc:3037] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:16.550762 11391 raft_consensus.cc:2454] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06d0d7c6aec6471bb09c54b381c0eb0c in term 1.
I20260924 17:33:16.550762 11259 raft_consensus.cc:2454] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06d0d7c6aec6471bb09c54b381c0eb0c in term 1.
I20260924 17:33:16.551043 11062 leader_election.cc:302] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06d0d7c6aec6471bb09c54b381c0eb0c, e9873d8627c848bdb1c4b67e00f3c428; no voters:
I20260924 17:33:16.551198 11456 raft_consensus.cc:2781] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:16.551378 11456 raft_consensus.cc:686] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 1 LEADER]: Becoming Leader. State: Replica: 06d0d7c6aec6471bb09c54b381c0eb0c, State: Running, Role: LEADER
I20260924 17:33:16.551476 11456 consensus_queue.cc:237] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } }
I20260924 17:33:16.552309 10983 catalog_manager.cc:5495] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 06d0d7c6aec6471bb09c54b381c0eb0c (127.6.37.1). New cstate: current_term: 1 leader_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06d0d7c6aec6471bb09c54b381c0eb0c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45881 } health_report { overall_health: HEALTHY } } }
I20260924 17:33:16.581389 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.580327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55984 (local address 127.6.37.1:45881)
0924 17:33:16.580399 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.580402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.580408 (+ 6us) server_negotiation.cc:407] Connection header received
0924 17:33:16.580442 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.580443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.580454 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.580539 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.581146 (+ 607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.581147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.581148 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.581152 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.581169 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.581173 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.581240 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.581298 (+ 58us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.581313 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:33:16.583235 11259 raft_consensus.cc:1261] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 1 FOLLOWER]: Refusing update from remote peer 06d0d7c6aec6471bb09c54b381c0eb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:16.583247 11391 raft_consensus.cc:1261] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 1 FOLLOWER]: Refusing update from remote peer 06d0d7c6aec6471bb09c54b381c0eb0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:16.583606 11461 consensus_queue.cc:1035] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9873d8627c848bdb1c4b67e00f3c428" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:16.583751 11456 consensus_queue.cc:1035] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7045cc7cdaec429caabfca48cda82f71" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 41811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:16.586266 11464 mvcc.cc:205] Tried to move back new op lower bound from 7332950821201920000 to 7332950821075369984. Current Snapshot: MvccSnapshot[applied={T|T < 7332950821201920000}]
I20260924 17:33:16.586654 11466 mvcc.cc:205] Tried to move back new op lower bound from 7332950821201920000 to 7332950821075369984. Current Snapshot: MvccSnapshot[applied={T|T < 7332950821201920000}]
I20260924 17:33:16.588735 10983 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:16.588810 10983 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:16.589663 10983 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 263bf31ff2b042bda5eb40c4b69232dd: Sending DeleteTablet for 3 replicas of tablet 10afe4dc262745d8b5a386fe72c91a41
I20260924 17:33:16.590014 11239 tablet_service.cc:1514] Processing DeleteTablet for tablet 10afe4dc262745d8b5a386fe72c91a41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:16 UTC) from {username='slave'} at 127.0.0.1:59294
I20260924 17:33:16.590080 11371 tablet_service.cc:1514] Processing DeleteTablet for tablet 10afe4dc262745d8b5a386fe72c91a41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:16 UTC) from {username='slave'} at 127.0.0.1:35042
I20260924 17:33:16.590287 11474 tablet_replica.cc:330] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: stopping tablet replica
I20260924 17:33:16.590291 11107 tablet_service.cc:1514] Processing DeleteTablet for tablet 10afe4dc262745d8b5a386fe72c91a41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:16 UTC) from {username='slave'} at 127.0.0.1:55972
I20260924 17:33:16.590404 11474 raft_consensus.cc:2229] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:16.590514 11474 raft_consensus.cc:2258] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:16.590529 11476 tablet_replica.cc:330] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c: stopping tablet replica
I20260924 17:33:16.590685 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11045
I20260924 17:33:16.590706 11476 raft_consensus.cc:2229] T 10afe4dc262745d8b5a386fe72c91a41 P 06d0d7c6aec6471bb09c54b381c0eb0c [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:16.591061 11474 ts_tablet_manager.cc:1905] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:16.592413 11475 tablet_replica.cc:330] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: stopping tablet replica
I20260924 17:33:16.592512 11475 raft_consensus.cc:2229] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:16.592623 11475 raft_consensus.cc:2258] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:16.593005 11474 ts_tablet_manager.cc:1918] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:16.593088 11474 log.cc:1196] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/10afe4dc262745d8b5a386fe72c91a41
I20260924 17:33:16.593390 11474 ts_tablet_manager.cc:1939] T 10afe4dc262745d8b5a386fe72c91a41 P e9873d8627c848bdb1c4b67e00f3c428: Deleting consensus metadata
I20260924 17:33:16.593652 11475 ts_tablet_manager.cc:1905] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:16.593804 10970 catalog_manager.cc:4841] TS e9873d8627c848bdb1c4b67e00f3c428 (127.6.37.2:40513): tablet 10afe4dc262745d8b5a386fe72c91a41 (table test-table [id=53217cf9ddb144619118c3cb443405f8]) successfully deleted
I20260924 17:33:16.595160 11475 ts_tablet_manager.cc:1918] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:16.595258 11475 log.cc:1196] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/10afe4dc262745d8b5a386fe72c91a41
I20260924 17:33:16.595511 11475 ts_tablet_manager.cc:1939] T 10afe4dc262745d8b5a386fe72c91a41 P 7045cc7cdaec429caabfca48cda82f71: Deleting consensus metadata
I20260924 17:33:16.595921 10968 catalog_manager.cc:4841] TS 7045cc7cdaec429caabfca48cda82f71 (127.6.37.3:41811): tablet 10afe4dc262745d8b5a386fe72c91a41 (table test-table [id=53217cf9ddb144619118c3cb443405f8]) successfully deleted
W20260924 17:33:16.597455 10970 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:45881 (error 108)
I20260924 17:33:16.597723 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11176
I20260924 17:33:16.598357 11445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.597804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45881 (local address 127.0.0.1:55994)
0924 17:33:16.598283 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.598322 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:45881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459}
W20260924 17:33:16.598716 10970 catalog_manager.cc:4584] TS 06d0d7c6aec6471bb09c54b381c0eb0c (127.6.37.1:45881): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 10afe4dc262745d8b5a386fe72c91a41: Network error: Client connection negotiation failed: client connection to 127.6.37.1:45881: connect: Connection refused (error 111)
I20260924 17:33:16.603510 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11308
I20260924 17:33:16.608315 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 10953
2026-09-24T17:33:16Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (785 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260924 17:33:16.628816 6292 mini_oidc.cc:152] Starting JWKS server
I20260924 17:33:16.630280 6292 webserver.cc:460] Webserver started at https://127.0.0.1:46195/ using document root <none> and password file <none>
I20260924 17:33:16.630425 6292 mini_oidc.cc:189] Starting OIDC Discovery server
I20260924 17:33:16.630637 6292 webserver.cc:460] Webserver started at http://127.0.0.1:36003/ using document root <none> and password file <none>
2026-09-24T17:33:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:16Z Disabled control of system clock
I20260924 17:33:16.639086 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:37295
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:41163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:37295
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46195/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/testchainca.cert with env {}
W20260924 17:33:16.720259 11483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:16.720455 11483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:16.720479 11483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:16.721539 11483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:16.721577 11483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:16.721591 11483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:16.721606 11483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:16.721618 11483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 17:33:16.721632 11483 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 17:33:16.721644 11483 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46195/jwks.json
I20260924 17:33:16.723129 11483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:37295
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:37295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46195/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:16.723322 11483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:16.723486 11483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:33:16.728376 11483 server_base.cc:1034] running on GCE node
W20260924 17:33:16.728396 11491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.728349 11489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.728348 11488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:16.728920 11483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:16.729219 11483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:16.730392 11483 hybrid_clock.cc:648] HybridClock initialized: now 1790271196730376 us; error 46 us; skew 500 ppm
I20260924 17:33:16.731678 11483 webserver.cc:460] Webserver started at http://127.6.37.62:35131/ using document root <none> and password file <none>
I20260924 17:33:16.731956 11483 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:16.732034 11483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:16.732187 11483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:16.733268 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "401e4d961f7647458a372bb3cf031f95"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "3e60f972f7777db13182e1f1e15c1d27"
server_key_iv: "8c5b2e4af70dd5ec530a7243c9ea571f"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.733618 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "401e4d961f7647458a372bb3cf031f95"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "3e60f972f7777db13182e1f1e15c1d27"
server_key_iv: "8c5b2e4af70dd5ec530a7243c9ea571f"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.735004 11483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:16.735771 11497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.735975 11483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:16.736086 11483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "401e4d961f7647458a372bb3cf031f95"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "3e60f972f7777db13182e1f1e15c1d27"
server_key_iv: "8c5b2e4af70dd5ec530a7243c9ea571f"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.736164 11483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:16.744289 11483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:16.744563 11483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:16.744711 11483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:16.748808 11483 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:37295
I20260924 17:33:16.748837 11550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:37295 every 8 connection(s)
I20260924 17:33:16.749167 11483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:16.750099 11551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:16.752360 11551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95: Bootstrap starting.
I20260924 17:33:16.752871 11551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:16.753192 11551 log.cc:824] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:16.753219 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11483
I20260924 17:33:16.753296 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:16.753513 6292 external_mini_cluster.cc:1428] Setting key 144ad358dd5d579b1ba8cbdbcb76370d
I20260924 17:33:16.753952 11551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95: No bootstrap required, opened a new log
I20260924 17:33:16.756443 11551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401e4d961f7647458a372bb3cf031f95" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37295 } }
I20260924 17:33:16.756573 11551 raft_consensus.cc:374] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:16.756596 11551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 401e4d961f7647458a372bb3cf031f95, State: Initialized, Role: FOLLOWER
I20260924 17:33:16.756719 11551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401e4d961f7647458a372bb3cf031f95" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37295 } }
I20260924 17:33:16.756793 11551 raft_consensus.cc:388] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:16.756882 11551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:16.756943 11551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:16.757576 11551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401e4d961f7647458a372bb3cf031f95" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37295 } }
I20260924 17:33:16.757679 11551 leader_election.cc:302] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 401e4d961f7647458a372bb3cf031f95; no voters:
I20260924 17:33:16.757817 11551 leader_election.cc:288] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:16.757850 11556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:16.758040 11556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [term 1 LEADER]: Becoming Leader. State: Replica: 401e4d961f7647458a372bb3cf031f95, State: Running, Role: LEADER
I20260924 17:33:16.758095 11551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:16.758168 11556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401e4d961f7647458a372bb3cf031f95" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37295 } }
I20260924 17:33:16.758651 11558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "401e4d961f7647458a372bb3cf031f95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401e4d961f7647458a372bb3cf031f95" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37295 } } }
I20260924 17:33:16.758639 11556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 401e4d961f7647458a372bb3cf031f95. Latest consensus state: current_term: 1 leader_uuid: "401e4d961f7647458a372bb3cf031f95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401e4d961f7647458a372bb3cf031f95" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37295 } } }
I20260924 17:33:16.758737 11558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:16.758744 11556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:16.759274 11565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:16.759841 11565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:16.760421 11555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.754115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36530 (local address 127.6.37.62:37295)
0924 17:33:16.754326 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.754334 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.754357 (+ 23us) server_negotiation.cc:407] Connection header received
0924 17:33:16.755229 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.755237 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.755308 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.755426 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:16.755677 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:16.756738 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:16.757931 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:16.758584 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:16.758692 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:16.759639 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:16.759643 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:16.759644 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:16.759862 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:16.759909 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:16.759925 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:16.759969 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:16.760126 (+ 157us) server_negotiation.cc:299] Negotiation successful
0924 17:33:16.760205 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260924 17:33:16.761534 11565 catalog_manager.cc:1347] Generated new cluster ID: f15996a9e2234e659e194bfb57454dc9
I20260924 17:33:16.761548 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:33:16.761622 11565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:16.781095 11565 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:16.781651 11565 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:16.785190 11565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 401e4d961f7647458a372bb3cf031f95: Generated new TSK 0
I20260924 17:33:16.785380 11565 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260924 17:33:16.817986 11581 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260924 17:33:16.818197 11581 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260924 17:33:16.818276 11555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:16.795156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36538 (local address 127.6.37.62:37295)
0924 17:33:16.795206 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:16.795209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:16.795298 (+ 89us) server_negotiation.cc:407] Connection header received
0924 17:33:16.795396 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:16.795397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:16.795407 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:16.795466 (+ 59us) server_negotiation.cc:226] Negotiated authn=JWT
0924 17:33:16.795622 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:16.796149 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:16.797268 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:16.797474 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:16.797530 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:16.797818 (+ 288us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 17:33:16.817986 (+ 20168us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46195/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0924 17:33:16.818186 (+ 200us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36538: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46195/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":23}
W20260924 17:33:16.818610 11555 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36538: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46195/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260924 17:33:16.818728 11580 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:16.795037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37295 (local address 127.0.0.1:36538)
0924 17:33:16.795220 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:16.795231 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:16.795304 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:16.795491 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:16.795492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:16.795494 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0924 17:33:16.795560 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:16.795563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:16.796234 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:16.796235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:16.797178 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:16.797181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:16.797551 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:16.797555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:16.797625 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:16.797646 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 17:33:16.818139 (+ 20493us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46195/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0924 17:33:16.818267 (+ 128us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.6.37.62:37295: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46195/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":102,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.6.37.62:37295: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46195/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260924 17:33:16.819284 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11483
2026-09-24T17:33:16Z chronyd exiting
I20260924 17:33:16.855494 6292 test_util.cc:175] -----------------------------------------------
I20260924 17:33:16.855571 6292 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790271173812085-6292-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (227 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260924 17:33:16.856443 6292 mini_oidc.cc:152] Starting JWKS server
I20260924 17:33:16.857151 6292 webserver.cc:460] Webserver started at https://127.0.0.1:40471/ using document root <none> and password file <none>
I20260924 17:33:16.857190 6292 mini_oidc.cc:189] Starting OIDC Discovery server
I20260924 17:33:16.857389 6292 webserver.cc:460] Webserver started at http://127.0.0.1:39351/ using document root <none> and password file <none>
2026-09-24T17:33:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:16Z Disabled control of system clock
I20260924 17:33:16.865096 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40305
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:40305
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40471/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/testchainca.cert with env {}
W20260924 17:33:16.947476 11587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:16.947683 11587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:16.947707 11587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:16.948797 11587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:16.948835 11587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:16.948849 11587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:16.948864 11587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:16.948879 11587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 17:33:16.948892 11587 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 17:33:16.948905 11587 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40471/jwks.json
I20260924 17:33:16.950372 11587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:40305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40471/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:16.950573 11587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:16.950735 11587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:16.955796 11592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:16.955823 11587 server_base.cc:1034] running on GCE node
W20260924 17:33:16.955801 11593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:16.955796 11595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:16.956393 11587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:16.956703 11587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:16.957873 11587 hybrid_clock.cc:648] HybridClock initialized: now 1790271196957893 us; error 61 us; skew 500 ppm
I20260924 17:33:16.959131 11587 webserver.cc:460] Webserver started at http://127.6.37.62:36635/ using document root <none> and password file <none>
I20260924 17:33:16.959368 11587 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:16.959439 11587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:16.959602 11587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:16.960930 11587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "10bdf0f49c254d249edbc33f537b17d7"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "a46f5c3f07c33ec450111b3fe8978c0f"
server_key_iv: "99b33e3ae47b1991af75a20f1d7ba39d"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.961355 11587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "10bdf0f49c254d249edbc33f537b17d7"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "a46f5c3f07c33ec450111b3fe8978c0f"
server_key_iv: "99b33e3ae47b1991af75a20f1d7ba39d"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.962795 11587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:16.963603 11601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:16.963783 11587 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:16.963892 11587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "10bdf0f49c254d249edbc33f537b17d7"
format_stamp: "Formatted at 2026-09-24 17:33:16 on dist-test-slave-gcz9"
server_key: "a46f5c3f07c33ec450111b3fe8978c0f"
server_key_iv: "99b33e3ae47b1991af75a20f1d7ba39d"
server_key_version: "encryptionkey@0"
I20260924 17:33:16.963963 11587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:16.989385 11587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:16.989753 11587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:16.989921 11587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:16.993912 11587 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:40305
I20260924 17:33:16.993947 11654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:40305 every 8 connection(s)
I20260924 17:33:16.994309 11587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:16.995384 11655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:16.997665 11655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7: Bootstrap starting.
I20260924 17:33:16.998286 11655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:16.998523 11655 log.cc:824] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:16.999221 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11587
I20260924 17:33:16.999329 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:16.999392 11655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7: No bootstrap required, opened a new log
I20260924 17:33:16.999532 6292 external_mini_cluster.cc:1428] Setting key 8e4576152de914ee7a3b3115c2bda625
I20260924 17:33:17.001825 11655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bdf0f49c254d249edbc33f537b17d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40305 } }
I20260924 17:33:17.001956 11655 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:17.001978 11655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10bdf0f49c254d249edbc33f537b17d7, State: Initialized, Role: FOLLOWER
I20260924 17:33:17.002113 11655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bdf0f49c254d249edbc33f537b17d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40305 } }
I20260924 17:33:17.002216 11655 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:17.002249 11655 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:17.002302 11655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:17.002986 11655 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bdf0f49c254d249edbc33f537b17d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40305 } }
I20260924 17:33:17.003091 11655 leader_election.cc:302] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10bdf0f49c254d249edbc33f537b17d7; no voters:
I20260924 17:33:17.003245 11655 leader_election.cc:288] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:17.003288 11660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:17.003429 11660 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [term 1 LEADER]: Becoming Leader. State: Replica: 10bdf0f49c254d249edbc33f537b17d7, State: Running, Role: LEADER
I20260924 17:33:17.003525 11655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:17.003573 11660 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bdf0f49c254d249edbc33f537b17d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40305 } }
I20260924 17:33:17.003931 11660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10bdf0f49c254d249edbc33f537b17d7. Latest consensus state: current_term: 1 leader_uuid: "10bdf0f49c254d249edbc33f537b17d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bdf0f49c254d249edbc33f537b17d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40305 } } }
I20260924 17:33:17.004086 11660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:17.004063 11661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10bdf0f49c254d249edbc33f537b17d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bdf0f49c254d249edbc33f537b17d7" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40305 } } }
I20260924 17:33:17.004225 11661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:17.004607 11669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:17.005544 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:17.000024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36994 (local address 127.6.37.62:40305)
0924 17:33:17.000244 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:17.000253 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:17.000287 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:33:17.000690 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:17.000697 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:17.000755 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:17.000914 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:17.001113 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.002057 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.003246 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.003914 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.004370 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.004779 (+ 409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:17.004782 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:17.004783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:17.005002 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:17.005043 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:17.005059 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:17.005120 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:17.005250 (+ 130us) server_negotiation.cc:299] Negotiation successful
0924 17:33:17.005348 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260924 17:33:17.005684 11669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:17.006502 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:33:17.007421 11669 catalog_manager.cc:1347] Generated new cluster ID: fd0e7b680b6749c1931ec09ac67c26b1
I20260924 17:33:17.007470 11669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:17.014465 11669 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:17.015129 11669 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:17.022429 11669 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10bdf0f49c254d249edbc33f537b17d7: Generated new TSK 0
I20260924 17:33:17.022601 11669 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260924 17:33:17.054203 11685 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260924 17:33:17.054306 11685 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260924 17:33:17.054563 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:17.032366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37008 (local address 127.6.37.62:40305)
0924 17:33:17.032435 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:17.032437 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:17.032562 (+ 125us) server_negotiation.cc:407] Connection header received
0924 17:33:17.032642 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:17.032642 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:17.032655 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:17.032751 (+ 96us) server_negotiation.cc:226] Negotiated authn=JWT
0924 17:33:17.032895 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.033381 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.034414 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.034652 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.034828 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.035050 (+ 222us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 17:33:17.054342 (+ 19292us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0924 17:33:17.054506 (+ 164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37008: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":43}
W20260924 17:33:17.054636 11659 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37008: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260924 17:33:17.054684 11684 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:17.032291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40305 (local address 127.0.0.1:37008)
0924 17:33:17.032482 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:17.032499 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:17.032575 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:17.032754 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:17.032755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:17.032756 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0924 17:33:17.032816 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:17.032818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.033722 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.033723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:17.034326 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:17.034328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.034831 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.034834 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:17.034924 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.034930 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 17:33:17.054461 (+ 19531us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0924 17:33:17.054582 (+ 121us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.6.37.62:40305: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":114,"threads_started":1}
I20260924 17:33:17.055130 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11587
2026-09-24T17:33:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (237 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260924 17:33:17.093537 6292 mini_oidc.cc:152] Starting JWKS server
I20260924 17:33:17.094306 6292 webserver.cc:460] Webserver started at https://127.0.0.1:33397/ using document root <none> and password file <none>
I20260924 17:33:17.094389 6292 mini_oidc.cc:189] Starting OIDC Discovery server
I20260924 17:33:17.094591 6292 webserver.cc:460] Webserver started at http://127.0.0.1:45671/ using document root <none> and password file <none>
2026-09-24T17:33:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:17Z Disabled control of system clock
I20260924 17:33:17.102645 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46337
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:46137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:46337
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33397/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260924 17:33:17.185218 11691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:17.185413 11691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:17.185434 11691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:17.186512 11691 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:17.186548 11691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:17.186561 11691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:17.186573 11691 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:17.186585 11691 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 17:33:17.186597 11691 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 17:33:17.186614 11691 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33397/jwks.json
I20260924 17:33:17.187994 11691 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:46137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:46337
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33397/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:17.188181 11691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:17.188398 11691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:17.193207 11697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:17.193284 11691 server_base.cc:1034] running on GCE node
W20260924 17:33:17.193223 11696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:17.193282 11699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:17.193641 11691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:17.193907 11691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:17.195073 11691 hybrid_clock.cc:648] HybridClock initialized: now 1790271197195060 us; error 25 us; skew 500 ppm
I20260924 17:33:17.196213 11691 webserver.cc:460] Webserver started at http://127.6.37.62:40757/ using document root <none> and password file <none>
I20260924 17:33:17.196455 11691 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:17.196523 11691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:17.196679 11691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:17.197731 11691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "4ca462e6fe564593be4f96620b697681"
format_stamp: "Formatted at 2026-09-24 17:33:17 on dist-test-slave-gcz9"
server_key: "537b176f13ba552b4efa0ed76747075c"
server_key_iv: "25d51a8ee3c2d9e51a143f1b255761bf"
server_key_version: "encryptionkey@0"
I20260924 17:33:17.198100 11691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "4ca462e6fe564593be4f96620b697681"
format_stamp: "Formatted at 2026-09-24 17:33:17 on dist-test-slave-gcz9"
server_key: "537b176f13ba552b4efa0ed76747075c"
server_key_iv: "25d51a8ee3c2d9e51a143f1b255761bf"
server_key_version: "encryptionkey@0"
I20260924 17:33:17.199683 11691 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:17.200394 11705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:17.200570 11691 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:17.200670 11691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "4ca462e6fe564593be4f96620b697681"
format_stamp: "Formatted at 2026-09-24 17:33:17 on dist-test-slave-gcz9"
server_key: "537b176f13ba552b4efa0ed76747075c"
server_key_iv: "25d51a8ee3c2d9e51a143f1b255761bf"
server_key_version: "encryptionkey@0"
I20260924 17:33:17.200759 11691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:17.232324 11691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:17.232707 11691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:17.232867 11691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:17.236997 11691 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:46337
I20260924 17:33:17.237032 11758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:46337 every 8 connection(s)
I20260924 17:33:17.237381 11691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:17.238049 11759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:17.240753 11759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681: Bootstrap starting.
I20260924 17:33:17.241322 11759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:17.241561 11759 log.cc:824] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:17.242250 11759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681: No bootstrap required, opened a new log
I20260924 17:33:17.243856 11759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca462e6fe564593be4f96620b697681" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46337 } }
I20260924 17:33:17.243991 11759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:17.244022 11759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca462e6fe564593be4f96620b697681, State: Initialized, Role: FOLLOWER
I20260924 17:33:17.244123 11759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca462e6fe564593be4f96620b697681" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46337 } }
I20260924 17:33:17.244174 11759 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:17.244194 11759 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:17.244220 11759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:17.244674 11759 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca462e6fe564593be4f96620b697681" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46337 } }
I20260924 17:33:17.244755 11759 leader_election.cc:302] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ca462e6fe564593be4f96620b697681; no voters:
I20260924 17:33:17.244874 11759 leader_election.cc:288] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:17.244930 11762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:17.245107 11762 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [term 1 LEADER]: Becoming Leader. State: Replica: 4ca462e6fe564593be4f96620b697681, State: Running, Role: LEADER
I20260924 17:33:17.245139 11759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:17.245217 11762 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca462e6fe564593be4f96620b697681" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46337 } }
I20260924 17:33:17.245766 11764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ca462e6fe564593be4f96620b697681. Latest consensus state: current_term: 1 leader_uuid: "4ca462e6fe564593be4f96620b697681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca462e6fe564593be4f96620b697681" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46337 } } }
I20260924 17:33:17.245865 11764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:17.246031 11763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ca462e6fe564593be4f96620b697681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ca462e6fe564593be4f96620b697681" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46337 } } }
I20260924 17:33:17.246086 11763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:17.246244 11771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:17.246701 11771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:17.246922 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11691
I20260924 17:33:17.247037 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:17.247203 6292 external_mini_cluster.cc:1428] Setting key 79513d4539907f0164d024fd4d6d2d76
I20260924 17:33:17.248318 11771 catalog_manager.cc:1347] Generated new cluster ID: 2e0d35fe3c354f2ba3e2061caeb5b7c0
I20260924 17:33:17.248382 11771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:17.253540 11781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:17.247626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47746 (local address 127.6.37.62:46337)
0924 17:33:17.247793 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:17.247802 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:17.247965 (+ 163us) server_negotiation.cc:407] Connection header received
0924 17:33:17.248136 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:17.248143 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:17.248212 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:17.248348 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:17.248661 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.250034 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.251128 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.251717 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.251816 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.252750 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:17.252755 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:17.252755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:17.252956 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:17.252993 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:17.253006 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:17.253053 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:17.253278 (+ 225us) server_negotiation.cc:299] Negotiation successful
0924 17:33:17.253348 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":67,"threads_started":1}
I20260924 17:33:17.254602 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:33:17.269465 11771 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:17.269953 11771 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:17.279695 11771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ca462e6fe564593be4f96620b697681: Generated new TSK 0
I20260924 17:33:17.279932 11771 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:33:17.297335 11781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:17.293332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.6.37.62:46337)
0924 17:33:17.293393 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:17.293395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:17.293469 (+ 74us) server_negotiation.cc:407] Connection header received
0924 17:33:17.293543 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:17.293544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:17.293557 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:17.293646 (+ 89us) server_negotiation.cc:226] Negotiated authn=JWT
0924 17:33:17.293738 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.294556 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.295517 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.295832 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.295924 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.296079 (+ 155us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 17:33:17.297094 (+ 1015us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0924 17:33:17.297247 (+ 153us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47760: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":36}
W20260924 17:33:17.297405 11781 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47760: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260924 17:33:17.299337 11788 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:17.293244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46337 (local address 127.0.0.1:47760)
0924 17:33:17.293421 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:17.293429 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:17.293479 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:17.293643 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:17.293643 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:17.293646 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0924 17:33:17.293696 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:17.293698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.294644 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.294645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:17.295415 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:17.295418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.295921 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.295924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:17.295971 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.295977 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 17:33:17.297210 (+ 1233us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0924 17:33:17.299228 (+ 2018us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.6.37.62:46337: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33397/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":1803,"thread_start_us":111,"threads_started":1}
I20260924 17:33:17.299599 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11691
E20260924 17:33:17.308532 11789 webserver.cc:533] Webserver: sslize failed:
E20260924 17:33:17.308596 11789 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-24T17:33:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (244 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-24T17:33:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:17Z Disabled control of system clock
I20260924 17:33:17.345709 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33597
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:33597
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/testchainca.cert with env {}
W20260924 17:33:17.426712 11793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:17.427016 11793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:17.427066 11793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:17.428257 11793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:17.428325 11793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:17.428347 11793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:17.428365 11793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:17.428397 11793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260924 17:33:17.428429 11793 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260924 17:33:17.428452 11793 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260924 17:33:17.429949 11793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:33597
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:17.430233 11793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:17.430449 11793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:17.435261 11799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:17.435286 11801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:17.435317 11798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:17.435593 11793 server_base.cc:1034] running on GCE node
I20260924 17:33:17.435899 11793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:17.436203 11793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:17.437382 11793 hybrid_clock.cc:648] HybridClock initialized: now 1790271197437368 us; error 69 us; skew 500 ppm
I20260924 17:33:17.438753 11793 webserver.cc:460] Webserver started at http://127.6.37.62:43333/ using document root <none> and password file <none>
I20260924 17:33:17.439046 11793 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:17.439119 11793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:17.439256 11793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:17.440389 11793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "56a37797997b4968b2d7ef0851281c2c"
format_stamp: "Formatted at 2026-09-24 17:33:17 on dist-test-slave-gcz9"
server_key: "2129b0e0a87fac865edf672a5270f3de"
server_key_iv: "ff491d86a08ec9aa8ca56efe3791e439"
server_key_version: "encryptionkey@0"
I20260924 17:33:17.440804 11793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "56a37797997b4968b2d7ef0851281c2c"
format_stamp: "Formatted at 2026-09-24 17:33:17 on dist-test-slave-gcz9"
server_key: "2129b0e0a87fac865edf672a5270f3de"
server_key_iv: "ff491d86a08ec9aa8ca56efe3791e439"
server_key_version: "encryptionkey@0"
I20260924 17:33:17.442217 11793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:17.442945 11807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:17.443104 11793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:17.443202 11793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "56a37797997b4968b2d7ef0851281c2c"
format_stamp: "Formatted at 2026-09-24 17:33:17 on dist-test-slave-gcz9"
server_key: "2129b0e0a87fac865edf672a5270f3de"
server_key_iv: "ff491d86a08ec9aa8ca56efe3791e439"
server_key_version: "encryptionkey@0"
I20260924 17:33:17.443288 11793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:17.453799 11793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:17.454090 11793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:17.454244 11793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:17.458238 11793 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:33597
I20260924 17:33:17.458269 11859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:33597 every 8 connection(s)
I20260924 17:33:17.458619 11793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:17.459604 11860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:17.459916 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11793
I20260924 17:33:17.460028 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:17.460245 6292 external_mini_cluster.cc:1428] Setting key 0b039aca825586ac74f54d00785ad9f4
I20260924 17:33:17.463052 11860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c: Bootstrap starting.
I20260924 17:33:17.463739 11860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:17.464069 11860 log.cc:824] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:17.464864 11860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c: No bootstrap required, opened a new log
I20260924 17:33:17.466029 11863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:17.460771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37938 (local address 127.6.37.62:33597)
0924 17:33:17.460982 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:17.460990 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:17.461020 (+ 30us) server_negotiation.cc:407] Connection header received
0924 17:33:17.461447 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:17.461454 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:17.461529 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:17.461642 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:17.461894 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.462754 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.463946 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.464485 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.464638 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.465270 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:17.465274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:17.465275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:33:17.465495 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:17.465537 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:33:17.465551 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:17.465622 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:17.465738 (+ 116us) server_negotiation.cc:299] Negotiation successful
0924 17:33:17.465823 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260924 17:33:17.467089 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:33:17.467414 11860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a37797997b4968b2d7ef0851281c2c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33597 } }
I20260924 17:33:17.467584 11860 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:17.467617 11860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56a37797997b4968b2d7ef0851281c2c, State: Initialized, Role: FOLLOWER
I20260924 17:33:17.467739 11860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a37797997b4968b2d7ef0851281c2c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33597 } }
I20260924 17:33:17.467826 11860 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:17.467859 11860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:17.467907 11860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:17.468477 11860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a37797997b4968b2d7ef0851281c2c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33597 } }
I20260924 17:33:17.468560 11860 leader_election.cc:302] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56a37797997b4968b2d7ef0851281c2c; no voters:
I20260924 17:33:17.468679 11860 leader_election.cc:288] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:17.468724 11865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:17.468883 11865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [term 1 LEADER]: Becoming Leader. State: Replica: 56a37797997b4968b2d7ef0851281c2c, State: Running, Role: LEADER
I20260924 17:33:17.468961 11860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:17.468966 11865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a37797997b4968b2d7ef0851281c2c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33597 } }
I20260924 17:33:17.469378 11867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56a37797997b4968b2d7ef0851281c2c. Latest consensus state: current_term: 1 leader_uuid: "56a37797997b4968b2d7ef0851281c2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a37797997b4968b2d7ef0851281c2c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33597 } } }
I20260924 17:33:17.469465 11867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:17.469720 11866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56a37797997b4968b2d7ef0851281c2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56a37797997b4968b2d7ef0851281c2c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33597 } } }
I20260924 17:33:17.469838 11866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:17.470006 11873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:17.470492 11873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:17.472046 11873 catalog_manager.cc:1347] Generated new cluster ID: 83db82fa001748328f731c70b120abd5
I20260924 17:33:17.472096 11873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:17.493343 11873 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:17.494055 11873 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:17.510026 11873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56a37797997b4968b2d7ef0851281c2c: Generated new TSK 0
I20260924 17:33:17.510272 11873 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:33:17.592585 11863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:17.521605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.6.37.62:33597)
0924 17:33:17.521650 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:17.521653 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:17.521731 (+ 78us) server_negotiation.cc:407] Connection header received
0924 17:33:17.521818 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:17.521819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:17.521829 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:17.521887 (+ 58us) server_negotiation.cc:226] Negotiated authn=JWT
0924 17:33:17.522041 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.522522 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.523675 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.523864 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.523916 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.524097 (+ 181us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0924 17:33:17.592356 (+ 68259us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0924 17:33:17.592527 (+ 171us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37946: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":25}
W20260924 17:33:17.592674 11863 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37946: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260924 17:33:17.592821 11890 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:17.521507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:33597 (local address 127.0.0.1:37946)
0924 17:33:17.521675 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:17.521686 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:17.521750 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:17.521908 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:17.521909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:17.521912 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0924 17:33:17.521973 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:17.521976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.522618 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.522619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:17.523599 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:17.523602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:17.523938 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:17.523941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:17.524002 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:17.524008 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0924 17:33:17.592524 (+ 68516us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0924 17:33:17.592676 (+ 152us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.6.37.62:33597: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260924 17:33:17.593266 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11793
2026-09-24T17:33:17Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (273 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (94 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (88 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:17 dist-test-slave-gcz9 krb5kdc[11902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:17 dist-test-slave-gcz9 krb5kdc[11902](info): set up 2 sockets
Sep 24 17:33:17 dist-test-slave-gcz9 krb5kdc[11902](info): commencing operation
krb5kdc: starting...
W20260924 17:33:18.828696 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260924 17:33:19.056084 6292 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.109s user 0.000s sys 0.001s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/test-user.keytab.
W20260924 17:33:19.749688 6292 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.693s user 0.001s sys 0.001s
Sep 24 17:33:19 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
W20260924 17:33:20.711826 6292 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.6.37.62: real 0.939s user 0.001s sys 0.002s
I20260924 17:33:20.712266 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:43803
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:43803
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:20.792754 11915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:20.792943 11915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:20.792965 11915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:20.794188 11915 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:20.794248 11915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:20.794272 11915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:20.794302 11915 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:20.794332 11915 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:20.795778 11915 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:43803
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:43803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:20.796043 11915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:20.796258 11915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:20.801126 11921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:20.801105 11923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:20.801141 11915 server_base.cc:1034] running on GCE node
W20260924 17:33:20.801112 11920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:20.801625 11915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:20.801941 11915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:20.803084 11915 hybrid_clock.cc:648] HybridClock initialized: now 1790271200803062 us; error 35 us; skew 500 ppm
Sep 24 17:33:20 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271200, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:20.812366 11915 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:20.812817 11915 webserver.cc:460] Webserver started at http://127.6.37.62:40393/ using document root <none> and password file <none>
I20260924 17:33:20.813067 11915 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:20.813113 11915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:20.813258 11915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:20.814304 11915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "81b47b6d3fbc47d8b404cffaf6df88da"
format_stamp: "Formatted at 2026-09-24 17:33:20 on dist-test-slave-gcz9"
server_key: "21f54aeae4cb4f34441ebb5672bc6106"
server_key_iv: "be832e84107ab1ce5af33913db41dcb8"
server_key_version: "encryptionkey@0"
I20260924 17:33:20.814663 11915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "81b47b6d3fbc47d8b404cffaf6df88da"
format_stamp: "Formatted at 2026-09-24 17:33:20 on dist-test-slave-gcz9"
server_key: "21f54aeae4cb4f34441ebb5672bc6106"
server_key_iv: "be832e84107ab1ce5af33913db41dcb8"
server_key_version: "encryptionkey@0"
I20260924 17:33:20.816031 11915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:20.816774 11930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:20.816994 11915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:20.817085 11915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "81b47b6d3fbc47d8b404cffaf6df88da"
format_stamp: "Formatted at 2026-09-24 17:33:20 on dist-test-slave-gcz9"
server_key: "21f54aeae4cb4f34441ebb5672bc6106"
server_key_iv: "be832e84107ab1ce5af33913db41dcb8"
server_key_version: "encryptionkey@0"
I20260924 17:33:20.817155 11915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:20.845763 11915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:20.848100 11915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:20.848246 11915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:20.852367 11915 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:43803
I20260924 17:33:20.852444 11982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:43803 every 8 connection(s)
I20260924 17:33:20.852763 11915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:20.853626 11983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:20.855947 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da: Bootstrap starting.
I20260924 17:33:20.856487 11983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:20.856727 11983 log.cc:824] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:20.857244 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 11915
I20260924 17:33:20.857352 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:20.857457 11983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da: No bootstrap required, opened a new log
I20260924 17:33:20.857575 6292 external_mini_cluster.cc:1428] Setting key 0bdf60c0cee1651e6e34917c58964b2c
I20260924 17:33:20.859907 11983 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 43803 } }
I20260924 17:33:20.860085 11983 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:20.860124 11983 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b47b6d3fbc47d8b404cffaf6df88da, State: Initialized, Role: FOLLOWER
I20260924 17:33:20.860266 11983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 43803 } }
I20260924 17:33:20.860359 11983 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:20.860389 11983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:20.860435 11983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:20.861106 11983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 43803 } }
I20260924 17:33:20.861212 11983 leader_election.cc:302] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81b47b6d3fbc47d8b404cffaf6df88da; no voters:
I20260924 17:33:20.861356 11983 leader_election.cc:288] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:20.861420 11988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:20.861573 11983 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:20.861578 11988 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [term 1 LEADER]: Becoming Leader. State: Replica: 81b47b6d3fbc47d8b404cffaf6df88da, State: Running, Role: LEADER
I20260924 17:33:20.861690 11988 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 43803 } }
I20260924 17:33:20.862067 11990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 43803 } } }
I20260924 17:33:20.862057 11988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81b47b6d3fbc47d8b404cffaf6df88da. Latest consensus state: current_term: 1 leader_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b47b6d3fbc47d8b404cffaf6df88da" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 43803 } } }
I20260924 17:33:20.862206 11988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:20.862391 11990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:20.862834 11997 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:20.863368 11997 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 24 17:33:20 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271199, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:20.865801 11997 catalog_manager.cc:1347] Generated new cluster ID: 190e8de6b7ce4f04b6f8bcaa10d67f1d
I20260924 17:33:20.865856 11997 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:20.870275 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:20.858107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48366 (local address 127.6.37.62:43803)
0924 17:33:20.858338 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:20.858349 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:20.858385 (+ 36us) server_negotiation.cc:407] Connection header received
0924 17:33:20.859097 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:20.859107 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:20.859171 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:20.859323 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:20.859924 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:20.861604 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:20.862863 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:20.863596 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:20.863707 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:20.866158 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:20.866163 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:20.866163 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:20.866176 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:20.868312 (+ 2136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:20.868704 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:20.868708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:20.868708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:20.868832 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:20.869042 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:20.869043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:20.869044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:20.869355 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:20.869516 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:20.869614 (+ 98us) server_negotiation.cc:299] Negotiation successful
0924 17:33:20.869888 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":98,"threads_started":1}
I20260924 17:33:20.874187 11997 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:20.874958 11997 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:20.880537 11997 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81b47b6d3fbc47d8b404cffaf6df88da: Generated new TSK 0
I20260924 17:33:20.880702 11997 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:33:20.910341 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:43803
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:20.993156 12009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:20.993438 12009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:20.993464 12009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:20.994727 12009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:20.994764 12009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:20.994789 12009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:20.996299 12009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:43803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:20.996536 12009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:20.996780 12009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:21.001773 12017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:21.001767 12015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:21.001767 12014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:21.001797 12009 server_base.cc:1034] running on GCE node
I20260924 17:33:21.002290 12009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:21.002552 12009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:21.003731 12009 hybrid_clock.cc:648] HybridClock initialized: now 1790271201003724 us; error 34 us; skew 500 ppm
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.006237 12009 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:33:21.006683 12009 webserver.cc:460] Webserver started at http://127.6.37.1:38717/ using document root <none> and password file <none>
I20260924 17:33:21.006954 12009 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:21.007021 12009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:21.007179 12009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:21.008320 12009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "d181441d3fb8461a9890b85fa42e54f1"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "eca1697c3e94c3593feb0a468b638a26"
server_key_iv: "e98c56f51ae2ab561edd0bd5b3b851f7"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.008721 12009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "d181441d3fb8461a9890b85fa42e54f1"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "eca1697c3e94c3593feb0a468b638a26"
server_key_iv: "e98c56f51ae2ab561edd0bd5b3b851f7"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.010059 12009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:21.010754 12024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.010952 12009 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:21.011050 12009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "d181441d3fb8461a9890b85fa42e54f1"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "eca1697c3e94c3593feb0a468b638a26"
server_key_iv: "e98c56f51ae2ab561edd0bd5b3b851f7"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.011130 12009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:21.021140 12009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:21.022858 12009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:21.023067 12009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:21.023304 12009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:21.023627 12009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:21.023680 12009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.023713 12009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:21.023741 12009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.029511 12009 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:43599
I20260924 17:33:21.029592 12139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:43599 every 8 connection(s)
I20260924 17:33:21.029908 12009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:21.035355 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12009
I20260924 17:33:21.035468 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:21.035689 6292 external_mini_cluster.cc:1428] Setting key c68b435614bee97315c1206ca149a00c
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:21.040131 12142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.030625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:43803 (local address 127.6.37.1:47725)
0924 17:33:21.030929 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:21.030980 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:21.031904 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:21.032119 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:21.032122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:21.032373 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:21.032572 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:21.032577 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.033235 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.033236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:21.034035 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:21.034037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.034391 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.034392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:21.034526 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.035085 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:21.035094 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:21.036828 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:21.038749 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:21.038757 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:21.038758 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:21.039056 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:21.039265 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:21.039266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:21.039266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:21.039363 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:21.039651 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:21.039656 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:21.039770 (+ 114us) client_negotiation.cc:769] Sending connection context
0924 17:33:21.039845 (+ 75us) client_negotiation.cc:240] Negotiation successful
0924 17:33:21.039961 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":112,"threads_started":1}
I20260924 17:33:21.040166 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.030636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47725 (local address 127.6.37.62:43803)
0924 17:33:21.030701 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.030704 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.031047 (+ 343us) server_negotiation.cc:407] Connection header received
0924 17:33:21.032000 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.032001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.032012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.032068 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.032642 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.033148 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.034106 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.034291 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.034342 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.036924 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:21.036925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:21.036925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:21.036932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:21.038661 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.039130 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.039132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.039132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.039196 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.039435 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.039437 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.039437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.039590 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:21.039657 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:21.039905 (+ 248us) server_negotiation.cc:299] Negotiation successful
0924 17:33:21.040004 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 17:33:21.040679 12140 heartbeater.cc:347] Connected to a master server at 127.6.37.62:43803
I20260924 17:33:21.040800 12140 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:21.040987 12140 heartbeater.cc:511] Master 127.6.37.62:43803 requested a full tablet report, sending...
I20260924 17:33:21.041582 11947 ts_manager.cc:194] Registered new tserver with Master: d181441d3fb8461a9890b85fa42e54f1 (127.6.37.1:43599)
I20260924 17:33:21.042590 11947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:47725
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:33:21.062994 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:43803
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:21.159417 12145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:21.159718 12145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:21.159759 12145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:21.161665 12145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:21.161751 12145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:21.161840 12145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:21.163741 12145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:43803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:21.164028 12145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:21.164268 12145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:21.169831 12151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:21.169886 12153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:21.169906 12150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:21.172125 12145 server_base.cc:1034] running on GCE node
I20260924 17:33:21.172345 12145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:21.172606 12145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:21.179949 12145 hybrid_clock.cc:648] HybridClock initialized: now 1790271201179907 us; error 51 us; skew 500 ppm
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.182389 12145 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:33:21.182843 12145 webserver.cc:460] Webserver started at http://127.6.37.2:33735/ using document root <none> and password file <none>
I20260924 17:33:21.183106 12145 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:21.183179 12145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:21.183320 12145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:21.184413 12145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "560f7985227c424f8c098ea73328a91a"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "a4cffacd5c27aa2bd79b99a468f81b42"
server_key_iv: "ea0af9ec4cde20ea94de5d467a2fdd57"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.184787 12145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "560f7985227c424f8c098ea73328a91a"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "a4cffacd5c27aa2bd79b99a468f81b42"
server_key_iv: "ea0af9ec4cde20ea94de5d467a2fdd57"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.186218 12145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:21.187091 12160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.187299 12145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:21.187402 12145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "560f7985227c424f8c098ea73328a91a"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "a4cffacd5c27aa2bd79b99a468f81b42"
server_key_iv: "ea0af9ec4cde20ea94de5d467a2fdd57"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.187482 12145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:21.199873 12145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:21.201794 12145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:21.201939 12145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:21.202179 12145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:21.202502 12145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:21.202559 12145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.202600 12145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:21.202628 12145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.208496 12145 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:39745
I20260924 17:33:21.208575 12274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:39745 every 8 connection(s)
I20260924 17:33:21.208890 12145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:21.217971 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12145
I20260924 17:33:21.218089 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:21.218210 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.209685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:60553 (local address 127.6.37.62:43803)
0924 17:33:21.209774 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.209777 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.209989 (+ 212us) server_negotiation.cc:407] Connection header received
0924 17:33:21.210984 (+ 995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.210986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.210997 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.211057 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.211662 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.212161 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.213118 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.213368 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.213433 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.215612 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:21.215613 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:21.215614 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:21.215622 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:21.216809 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.217221 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.217223 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.217223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.217283 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.217542 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.217543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.217543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.217655 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:21.217728 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:21.218035 (+ 307us) server_negotiation.cc:299] Negotiation successful
0924 17:33:21.218117 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260924 17:33:21.218341 6292 external_mini_cluster.cc:1428] Setting key 8ee5d0e7760d8001fdb1b38e42d23168
I20260924 17:33:21.218441 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.209644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:43803 (local address 127.6.37.2:60553)
0924 17:33:21.209863 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:21.209899 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:21.210814 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:21.211127 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:21.211131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:21.211384 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:21.211584 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:21.211589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.212237 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.212238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:21.213041 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:21.213043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.213449 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.213450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:21.213558 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.214050 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:21.214059 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:21.215513 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:21.216906 (+ 1393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:21.216913 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:21.216916 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:21.217141 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:21.217352 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:21.217353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:21.217353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:21.217464 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:21.217734 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:21.217741 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:21.217877 (+ 136us) client_negotiation.cc:769] Sending connection context
0924 17:33:21.218013 (+ 136us) client_negotiation.cc:240] Negotiation successful
0924 17:33:21.218173 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":136,"threads_started":1}
I20260924 17:33:21.218950 12275 heartbeater.cc:347] Connected to a master server at 127.6.37.62:43803
I20260924 17:33:21.219071 12275 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:21.219276 12275 heartbeater.cc:511] Master 127.6.37.62:43803 requested a full tablet report, sending...
I20260924 17:33:21.219708 11947 ts_manager.cc:194] Registered new tserver with Master: 560f7985227c424f8c098ea73328a91a (127.6.37.2:39745)
I20260924 17:33:21.220219 11947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:60553
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:33:21.243898 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:43803
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:21.325886 12280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:21.326122 12280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:21.326161 12280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:21.327322 12280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:21.327397 12280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:21.327446 12280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:21.329283 12280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:43803
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:21.329602 12280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:21.329847 12280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:21.334990 12286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:21.334967 12288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:21.334932 12285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:21.335008 12280 server_base.cc:1034] running on GCE node
I20260924 17:33:21.335446 12280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:21.335693 12280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:21.336908 12280 hybrid_clock.cc:648] HybridClock initialized: now 1790271201336896 us; error 45 us; skew 500 ppm
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.339491 12280 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:33:21.340019 12280 webserver.cc:460] Webserver started at http://127.6.37.3:46553/ using document root <none> and password file <none>
I20260924 17:33:21.340255 12280 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:21.340337 12280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:21.340487 12280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:21.341562 12280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "fa86efea8bde4c39839c3f823f1e866e"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "6070fad7ad96929bd2022c07aa30e370"
server_key_iv: "c76aa4170b150f950701efcd9399e1fb"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.341930 12280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "fa86efea8bde4c39839c3f823f1e866e"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "6070fad7ad96929bd2022c07aa30e370"
server_key_iv: "c76aa4170b150f950701efcd9399e1fb"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.343436 12280 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:21.344264 12295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.344451 12280 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:21.344561 12280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "fa86efea8bde4c39839c3f823f1e866e"
format_stamp: "Formatted at 2026-09-24 17:33:21 on dist-test-slave-gcz9"
server_key: "6070fad7ad96929bd2022c07aa30e370"
server_key_iv: "c76aa4170b150f950701efcd9399e1fb"
server_key_version: "encryptionkey@0"
I20260924 17:33:21.344638 12280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:21.356464 12280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:21.358428 12280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:21.358597 12280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:21.358911 12280 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:21.359244 12280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:21.359298 12280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.359332 12280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:21.359360 12280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:21.365782 12280 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:37699
I20260924 17:33:21.365880 12409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:37699 every 8 connection(s)
I20260924 17:33:21.366201 12280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:21.368587 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12280
I20260924 17:33:21.368690 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:21.368891 6292 external_mini_cluster.cc:1428] Setting key 4a5ad0fd87bcb8b1f828062d801ac95a
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:33:21.375715 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.366958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:36019 (local address 127.6.37.62:43803)
0924 17:33:21.367011 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.367013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.367251 (+ 238us) server_negotiation.cc:407] Connection header received
0924 17:33:21.368164 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.368165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.368174 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.368226 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.369076 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.369890 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.370988 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.371165 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.371218 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.373341 (+ 2123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:21.373342 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:21.373343 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:21.373349 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:21.374517 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.374911 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.374913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.374913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.374981 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.375211 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.375211 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.375211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.375312 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:21.375364 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:21.375593 (+ 229us) server_negotiation.cc:299] Negotiation successful
0924 17:33:21.375652 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:33:21.375902 12412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.366964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:43803 (local address 127.6.37.3:36019)
0924 17:33:21.367130 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:21.367167 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:21.368073 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:21.368281 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:21.368284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:21.368669 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:21.368966 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:21.368973 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.369987 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.369988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:21.370834 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:21.370836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.371239 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.371240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:21.371350 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.371896 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:21.371905 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:21.373263 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:21.374588 (+ 1325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:21.374594 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:21.374596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:21.374803 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:21.375047 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:21.375047 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:21.375048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:21.375153 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:21.375369 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:21.375374 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:21.375485 (+ 111us) client_negotiation.cc:769] Sending connection context
0924 17:33:21.375569 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:33:21.375685 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260924 17:33:21.376454 12410 heartbeater.cc:347] Connected to a master server at 127.6.37.62:43803
I20260924 17:33:21.376536 12410 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:21.376683 12410 heartbeater.cc:511] Master 127.6.37.62:43803 requested a full tablet report, sending...
I20260924 17:33:21.377050 11947 ts_manager.cc:194] Registered new tserver with Master: fa86efea8bde4c39839c3f823f1e866e (127.6.37.3:37699)
I20260924 17:33:21.377375 11947 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:36019
I20260924 17:33:21.380573 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/test-admin.keytab.
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.396193 6292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260924 17:33:21.398034 12417 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:21.397140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46588 (local address 127.6.37.1:43599)
0924 17:33:21.397314 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.397319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.397328 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:21.397354 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.397356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.397369 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.397454 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.397934 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46588: BlockingRecv error: recv got EOF from 127.0.0.1:46588 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":72,"threads_started":1}
W20260924 17:33:21.398142 6292 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc' of type FILE
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.399204 6292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.400105 6292 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:33:21.408056 12417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.400644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46590 (local address 127.6.37.1:43599)
0924 17:33:21.400702 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.400704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.400758 (+ 54us) server_negotiation.cc:407] Connection header received
0924 17:33:21.400842 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.400843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.400852 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.400903 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.401303 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.402018 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.402769 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.403156 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.403213 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.405329 (+ 2116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:21.405338 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:21.405338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:21.405345 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:21.407018 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.407344 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.407347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.407348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.407405 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.407572 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.407573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.407573 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.407713 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:21.407829 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:21.407900 (+ 71us) server_negotiation.cc:299] Negotiation successful
0924 17:33:21.407965 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260924 17:33:21.409983 12417 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:21.409413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46598 (local address 127.6.37.1:43599)
0924 17:33:21.409449 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.409450 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.409498 (+ 48us) server_negotiation.cc:407] Connection header received
0924 17:33:21.409564 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.409565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.409574 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.409621 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.409908 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46598: BlockingRecv error: recv got EOF from 127.0.0.1:46598 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260924 17:33:21.410131 6292 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc' of type FILE
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.411223 6292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.412149 6292 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:33:21.419483 12417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.412746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46610 (local address 127.6.37.1:43599)
0924 17:33:21.412808 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.412809 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.412904 (+ 95us) server_negotiation.cc:407] Connection header received
0924 17:33:21.412923 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.412923 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.412933 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.412980 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.413323 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.413794 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.414566 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.414767 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.414825 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.417061 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:21.417062 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:21.417062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:21.417069 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:21.418431 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.418733 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.418734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.418734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.418782 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.419031 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.419032 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.419032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.419125 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:21.419199 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:21.419292 (+ 93us) server_negotiation.cc:299] Negotiation successful
0924 17:33:21.419349 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260924 17:33:21.421301 12417 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:21.420577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46622 (local address 127.6.37.1:43599)
0924 17:33:21.420663 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.420665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.420676 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:33:21.420773 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.420774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.420784 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.420964 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.421244 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46622: BlockingRecv error: recv got EOF from 127.0.0.1:46622 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260924 17:33:21.421543 6292 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790271173812085-6292-0/krb5kdc/krb5cc)
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.422526 6292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:21.423434 6292 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[11902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.1@KRBTEST.COM
I20260924 17:33:21.430136 12417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:21.423991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46638 (local address 127.6.37.1:43599)
0924 17:33:21.424043 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:21.424044 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:21.424078 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:33:21.424139 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:21.424140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:21.424147 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:21.424192 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:21.424519 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.425026 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.425663 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:21.425873 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:21.425927 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:21.427953 (+ 2026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:21.427954 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:21.427954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:21.427960 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:21.429196 (+ 1236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.429533 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.429534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.429534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.429580 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:21.429744 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:21.429745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:21.429745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:21.429827 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:21.429902 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:21.430025 (+ 123us) server_negotiation.cc:299] Negotiation successful
0924 17:33:21.430078 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260924 17:33:21.430763 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12009
I20260924 17:33:21.436137 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12145
I20260924 17:33:21.440886 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12280
I20260924 17:33:21.445191 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 11915
2026-09-24T17:33:21Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3671 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[12430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[12430](info): set up 2 sockets
Sep 24 17:33:21 dist-test-slave-gcz9 krb5kdc[12430](info): commencing operation
krb5kdc: starting...
W20260924 17:33:22.497418 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:22 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab.
Entry for principal oryx/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab.
I20260924 17:33:22.617192 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42529
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab
--principal=oryx/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42529
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:22.698940 12443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:22.699175 12443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:22.699213 12443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:22.700325 12443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:22.700388 12443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:22.700413 12443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:22.700445 12443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:22.700472 12443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:22.701911 12443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42529
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab
--principal=oryx/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:22.702188 12443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:22.702406 12443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:22.707330 12448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:22.707325 12449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:22.707577 12451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:22.707599 12443 server_base.cc:1034] running on GCE node
I20260924 17:33:22.707857 12443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:22.708179 12443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:22.709378 12443 hybrid_clock.cc:648] HybridClock initialized: now 1790271202709354 us; error 38 us; skew 500 ppm
Sep 24 17:33:22 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:22.711867 12443 init.cc:377] Logged in from keytab as oryx/127.6.37.62@KRBTEST.COM (short username oryx)
I20260924 17:33:22.712318 12443 webserver.cc:460] Webserver started at http://127.6.37.62:43671/ using document root <none> and password file <none>
I20260924 17:33:22.712505 12443 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:22.712545 12443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:22.712630 12443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:22.713593 12443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "c037a5d7cb484408a9e95ce76dc4ae63"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "5f159e17f439573afdb75d6b38ef43f5"
server_key_iv: "765792806c2eed89e6759600a6d89510"
server_key_version: "encryptionkey@0"
I20260924 17:33:22.713898 12443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "c037a5d7cb484408a9e95ce76dc4ae63"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "5f159e17f439573afdb75d6b38ef43f5"
server_key_iv: "765792806c2eed89e6759600a6d89510"
server_key_version: "encryptionkey@0"
I20260924 17:33:22.715265 12443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:22.716002 12458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:22.716213 12443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:22.716300 12443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "c037a5d7cb484408a9e95ce76dc4ae63"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "5f159e17f439573afdb75d6b38ef43f5"
server_key_iv: "765792806c2eed89e6759600a6d89510"
server_key_version: "encryptionkey@0"
I20260924 17:33:22.716359 12443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:22.734128 12443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:22.736408 12443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:22.736517 12443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:22.740494 12443 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:42529
I20260924 17:33:22.740553 12511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:42529 every 8 connection(s)
I20260924 17:33:22.740898 12443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:22.741462 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12443
I20260924 17:33:22.741588 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:22.741778 6292 external_mini_cluster.cc:1428] Setting key 753fb43dde137d10d79d774112c569df
I20260924 17:33:22.741991 12512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:22.744812 12512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Bootstrap starting.
I20260924 17:33:22.745415 12512 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:22.745729 12512 log.cc:824] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:22.746397 12512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: No bootstrap required, opened a new log
Sep 24 17:33:22 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:22.748198 12512 raft_consensus.cc:348] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } }
I20260924 17:33:22.748402 12512 raft_consensus.cc:374] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:22.748473 12512 raft_consensus.cc:729] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c037a5d7cb484408a9e95ce76dc4ae63, State: Initialized, Role: FOLLOWER
I20260924 17:33:22.748606 12512 consensus_queue.cc:260] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } }
I20260924 17:33:22.748711 12512 raft_consensus.cc:388] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:22.748756 12512 raft_consensus.cc:482] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:22.748803 12512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:22.749514 12512 raft_consensus.cc:504] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } }
I20260924 17:33:22.749643 12512 leader_election.cc:302] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c037a5d7cb484408a9e95ce76dc4ae63; no voters:
I20260924 17:33:22.749831 12512 leader_election.cc:288] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:22.749859 12517 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:22.749969 12517 raft_consensus.cc:686] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 1 LEADER]: Becoming Leader. State: Replica: c037a5d7cb484408a9e95ce76dc4ae63, State: Running, Role: LEADER
I20260924 17:33:22.750049 12517 consensus_queue.cc:237] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } }
I20260924 17:33:22.750108 12512 sys_catalog.cc:564] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:22.750356 12517 sys_catalog.cc:455] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } }
I20260924 17:33:22.750521 12517 sys_catalog.cc:458] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:22.750715 12517 sys_catalog.cc:455] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c037a5d7cb484408a9e95ce76dc4ae63. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } }
I20260924 17:33:22.750818 12517 sys_catalog.cc:458] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:22.751221 12524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:22.751775 12524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:22.752625 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:22.742296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58836 (local address 127.6.37.62:42529)
0924 17:33:22.742495 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:22.742502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:22.742527 (+ 25us) server_negotiation.cc:407] Connection header received
0924 17:33:22.743156 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:22.743164 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:22.743213 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:22.743398 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:22.744054 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:22.744969 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:22.745850 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:22.746254 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:22.746394 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:22.748744 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:22.748748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:22.748749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:22.748761 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:22.750692 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:22.751150 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:22.751155 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:22.751156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:22.751260 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:22.751596 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:22.751597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:22.751597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:22.751950 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:22.752117 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:22.752289 (+ 172us) server_negotiation.cc:299] Negotiation successful
0924 17:33:22.752429 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":94,"threads_started":1}
I20260924 17:33:22.753801 12524 catalog_manager.cc:1347] Generated new cluster ID: 38d120ce539644a98e518a32a096c4e4
I20260924 17:33:22.753855 12524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:22.763949 12524 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:22.764626 12524 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:22.774036 12524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Generated new TSK 0
I20260924 17:33:22.774216 12524 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab.
Entry for principal oryx/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab.
I20260924 17:33:22.801728 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42529
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:22.881990 12538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:22.882216 12538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:22.882256 12538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:22.883451 12538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:22.883522 12538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:22.883569 12538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:22.885010 12538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:22.885265 12538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:22.885484 12538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:22.890460 12543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:22.890532 12538 server_base.cc:1034] running on GCE node
W20260924 17:33:22.890470 12544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:22.890497 12546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:22.890980 12538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:22.891238 12538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:22.892400 12538 hybrid_clock.cc:648] HybridClock initialized: now 1790271202892388 us; error 26 us; skew 500 ppm
Sep 24 17:33:22 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:22.895061 12538 init.cc:377] Logged in from keytab as oryx/127.6.37.1@KRBTEST.COM (short username oryx)
I20260924 17:33:22.895444 12538 webserver.cc:460] Webserver started at http://127.6.37.1:46625/ using document root <none> and password file <none>
I20260924 17:33:22.895630 12538 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:22.895675 12538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:22.895764 12538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:22.896762 12538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "6e988d5858a244408d25821580b7a548"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "95ca42b6f7a0bccb5d1b5f00db49e54d"
server_key_iv: "56e2a4fa1784baa186433e5413674335"
server_key_version: "encryptionkey@0"
I20260924 17:33:22.897094 12538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "6e988d5858a244408d25821580b7a548"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "95ca42b6f7a0bccb5d1b5f00db49e54d"
server_key_iv: "56e2a4fa1784baa186433e5413674335"
server_key_version: "encryptionkey@0"
I20260924 17:33:22.898396 12538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:22.899145 12553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:22.899313 12538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:22.899420 12538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "6e988d5858a244408d25821580b7a548"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "95ca42b6f7a0bccb5d1b5f00db49e54d"
server_key_iv: "56e2a4fa1784baa186433e5413674335"
server_key_version: "encryptionkey@0"
I20260924 17:33:22.899494 12538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:22.914047 12538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:22.915879 12538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:22.916028 12538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:22.916244 12538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:22.916548 12538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:22.916601 12538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:22.916648 12538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:22.916677 12538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:22.922415 12538 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:45869
I20260924 17:33:22.922518 12667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:45869 every 8 connection(s)
I20260924 17:33:22.922808 12538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:22.926754 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12538
I20260924 17:33:22.926964 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:22.927219 6292 external_mini_cluster.cc:1428] Setting key bfe0689cdd8a96e17731752af163cf67
Sep 24 17:33:22 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:22.933116 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:22.923561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:58189 (local address 127.6.37.62:42529)
0924 17:33:22.923608 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:22.923610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:22.923828 (+ 218us) server_negotiation.cc:407] Connection header received
0924 17:33:22.924367 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:22.924369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:22.924386 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:22.924486 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:22.925426 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:22.925995 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:22.927018 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:22.927362 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:22.927452 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:22.929969 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:22.929970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:22.929970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:22.929980 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:22.931596 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:22.932069 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:22.932070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:22.932071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:22.932136 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:22.932408 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:22.932409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:22.932410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:22.932535 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:22.932621 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:22.932918 (+ 297us) server_negotiation.cc:299] Negotiation successful
0924 17:33:22.933017 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:33:22.933315 12670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:22.923553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:58189)
0924 17:33:22.923712 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:22.923746 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:22.924204 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:22.924581 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:22.924585 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:22.925134 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:22.925324 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:22.925328 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:22.926081 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:22.926081 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:22.926896 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:22.926898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:22.927465 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:22.927467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:22.927645 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:22.928231 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:22.928240 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:22.929862 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:22.931695 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:22.931704 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:22.931706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:22.931970 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:22.932209 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:22.932210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:22.932211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:22.932332 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:22.932610 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:22.932618 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:22.932766 (+ 148us) client_negotiation.cc:769] Sending connection context
0924 17:33:22.932894 (+ 128us) client_negotiation.cc:240] Negotiation successful
0924 17:33:22.933058 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":83,"threads_started":1}
I20260924 17:33:22.933969 12668 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42529
I20260924 17:33:22.934091 12668 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:22.934296 12668 heartbeater.cc:511] Master 127.6.37.62:42529 requested a full tablet report, sending...
I20260924 17:33:22.934865 12475 ts_manager.cc:194] Registered new tserver with Master: 6e988d5858a244408d25821580b7a548 (127.6.37.1:45869)
WARNING: no policy specified for oryx/127.6.37.2@KRBTEST.COM; defaulting to no policy
I20260924 17:33:22.935519 12475 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:58189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab.
Entry for principal oryx/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab.
I20260924 17:33:22.965965 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42529
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:23.046635 12673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:23.046869 12673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:23.046926 12673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:23.048094 12673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:23.048159 12673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:23.048205 12673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:23.049665 12673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:23.049927 12673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:23.050154 12673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.055266 12678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.055336 12681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.055552 12673 server_base.cc:1034] running on GCE node
W20260924 17:33:23.055280 12679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.055812 12673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.056061 12673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.057204 12673 hybrid_clock.cc:648] HybridClock initialized: now 1790271203057181 us; error 36 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.059715 12673 init.cc:377] Logged in from keytab as oryx/127.6.37.2@KRBTEST.COM (short username oryx)
I20260924 17:33:23.060186 12673 webserver.cc:460] Webserver started at http://127.6.37.2:42123/ using document root <none> and password file <none>
I20260924 17:33:23.060424 12673 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.060490 12673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.060639 12673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:23.061693 12673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "90fbeebd5ec54841b818e8e3aea9aaee"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ef9f58ca843c6ef1a4d2b7045e3678ea"
server_key_iv: "9b42d3786db92572fa09320e2a585a76"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.062043 12673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "90fbeebd5ec54841b818e8e3aea9aaee"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ef9f58ca843c6ef1a4d2b7045e3678ea"
server_key_iv: "9b42d3786db92572fa09320e2a585a76"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.063397 12673 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:33:23.064118 12688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.064313 12673 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:23.064409 12673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "90fbeebd5ec54841b818e8e3aea9aaee"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ef9f58ca843c6ef1a4d2b7045e3678ea"
server_key_iv: "9b42d3786db92572fa09320e2a585a76"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.064482 12673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.077205 12673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.079439 12673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:23.079594 12673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.079819 12673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:23.080106 12673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:23.080176 12673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.080216 12673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:23.080245 12673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.085920 12673 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:37129
I20260924 17:33:23.085991 12801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:37129 every 8 connection(s)
I20260924 17:33:23.086303 12673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:23.090516 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12673
I20260924 17:33:23.090646 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:23.090852 6292 external_mini_cluster.cc:1428] Setting key c5b572e0ae1644db8ef89d2e741c52c0
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:23.096262 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.087078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:43547 (local address 127.6.37.62:42529)
0924 17:33:23.087149 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.087151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.087336 (+ 185us) server_negotiation.cc:407] Connection header received
0924 17:33:23.087759 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.087760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.087796 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.087863 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.088752 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.089314 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.090275 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.090484 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.090550 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.093083 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.093085 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.093086 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.093095 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.094666 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.095188 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.095190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.095190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.095255 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.095538 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.095539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.095540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.095685 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.095753 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.096048 (+ 295us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.096162 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:33:23.096433 12804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.087036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:43547)
0924 17:33:23.087184 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.087219 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.087675 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.087932 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.087936 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.088469 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.088660 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.088664 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.089409 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.089410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.090191 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.090193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.090576 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.090578 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.090742 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.091367 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.091375 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.092982 (+ 1607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.094799 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.094806 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.094808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.095108 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.095331 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.095332 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.095332 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.095459 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.095743 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.095751 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.095898 (+ 147us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.096009 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.096175 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":86,"threads_started":1}
I20260924 17:33:23.096906 12802 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42529
I20260924 17:33:23.096995 12802 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:23.097182 12802 heartbeater.cc:511] Master 127.6.37.62:42529 requested a full tablet report, sending...
I20260924 17:33:23.097609 12475 ts_manager.cc:194] Registered new tserver with Master: 90fbeebd5ec54841b818e8e3aea9aaee (127.6.37.2:37129)
I20260924 17:33:23.098071 12475 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:43547
WARNING: no policy specified for oryx/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab.
Entry for principal oryx/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab.
I20260924 17:33:23.117131 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42529
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:23.197682 12807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:23.197873 12807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:23.197896 12807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:23.199049 12807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:23.199090 12807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:23.199115 12807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:23.200524 12807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42529
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:23.200783 12807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:23.201058 12807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.206374 12815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.206398 12813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.206440 12807 server_base.cc:1034] running on GCE node
W20260924 17:33:23.206409 12812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.206790 12807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.207082 12807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.208226 12807 hybrid_clock.cc:648] HybridClock initialized: now 1790271203208204 us; error 37 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.210638 12807 init.cc:377] Logged in from keytab as oryx/127.6.37.3@KRBTEST.COM (short username oryx)
I20260924 17:33:23.211113 12807 webserver.cc:460] Webserver started at http://127.6.37.3:39411/ using document root <none> and password file <none>
I20260924 17:33:23.211356 12807 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.211426 12807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.211565 12807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:23.212590 12807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "9482df821b3d45e1a6e0b3617ef2cc46"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ab9c6ba8abdab239e28e3ebf7b8d7d73"
server_key_iv: "399df22d1b80e03662804c0eacac699f"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.212944 12807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "9482df821b3d45e1a6e0b3617ef2cc46"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ab9c6ba8abdab239e28e3ebf7b8d7d73"
server_key_iv: "399df22d1b80e03662804c0eacac699f"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.214262 12807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:23.215070 12822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.215252 12807 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:23.215349 12807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "9482df821b3d45e1a6e0b3617ef2cc46"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ab9c6ba8abdab239e28e3ebf7b8d7d73"
server_key_iv: "399df22d1b80e03662804c0eacac699f"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.215432 12807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.233210 12807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.235140 12807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:23.235306 12807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.235546 12807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:23.235862 12807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:23.235916 12807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.235958 12807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:23.235986 12807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.242008 12807 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38763
I20260924 17:33:23.242067 12935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38763 every 8 connection(s)
I20260924 17:33:23.242404 12807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:23.251523 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.243203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:39145 (local address 127.6.37.62:42529)
0924 17:33:23.243264 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.243266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.243471 (+ 205us) server_negotiation.cc:407] Connection header received
0924 17:33:23.243948 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.243949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.243959 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.244018 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.244877 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.245386 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.246373 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.246559 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.246623 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.248722 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.248723 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.248723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.248731 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.250187 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.250582 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.250583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.250583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.250633 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.250905 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.250906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.250907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.251026 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.251081 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.251386 (+ 305us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.251456 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260924 17:33:23.251715 12938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.243188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:39145)
0924 17:33:23.243350 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.243391 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.243869 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.244070 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.244073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.244615 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.244799 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.244804 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.245466 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.245466 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.246290 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.246293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.246646 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.246647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.246751 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.247200 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.247208 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.248634 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.250303 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.250308 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.250310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.250514 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.250693 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.250693 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.250693 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.250786 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.251087 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.251105 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.251220 (+ 115us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.251356 (+ 136us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.251488 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260924 17:33:23.252178 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12807
I20260924 17:33:23.252177 12936 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42529
I20260924 17:33:23.252279 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:23.252285 12936 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:23.252458 12936 heartbeater.cc:511] Master 127.6.37.62:42529 requested a full tablet report, sending...
I20260924 17:33:23.252483 6292 external_mini_cluster.cc:1428] Setting key 81b6418281f09813c8a4149551a75759
I20260924 17:33:23.252871 12474 ts_manager.cc:194] Registered new tserver with Master: 9482df821b3d45e1a6e0b3617ef2cc46 (127.6.37.3:38763)
I20260924 17:33:23.253257 12474 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:39145
I20260924 17:33:23.253984 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.6.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.61.keytab.
Entry for principal oryx/127.6.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.61.keytab.
I20260924 17:33:23.279672 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:41699
--webserver_interface=127.6.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.61.keytab
--principal=oryx/127.6.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42529,127.6.37.61:41699
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:23.360750 12941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:23.360950 12941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:23.360972 12941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:23.362088 12941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:23.362130 12941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:23.362145 12941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:23.362159 12941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:23.362170 12941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:23.363636 12941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42529,127.6.37.61:41699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.61.keytab
--principal=oryx/127.6.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:41699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
W20260924 17:33:23.363739 12941 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.6.37.62:42529,127.6.37.61:41699'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260924 17:33:23.363896 12941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:23.364133 12941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.369037 12946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.369050 12949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.369053 12947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.369092 12941 server_base.cc:1034] running on GCE node
I20260924 17:33:23.369557 12941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.369856 12941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.371017 12941 hybrid_clock.cc:648] HybridClock initialized: now 1790271203371020 us; error 44 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.373616 12941 init.cc:377] Logged in from keytab as oryx/127.6.37.61@KRBTEST.COM (short username oryx)
I20260924 17:33:23.374083 12941 webserver.cc:460] Webserver started at http://127.6.37.61:41179/ using document root <none> and password file <none>
I20260924 17:33:23.374316 12941 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.374384 12941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.374545 12941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:23.375658 12941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/instance:
uuid: "1c99553586a74095a79d682dbb31cd3a"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "6cb787ccbe19084202276387b1dc38ca"
server_key_iv: "1f41cce5c9e9370485a254946cc1974e"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.376014 12941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal/instance:
uuid: "1c99553586a74095a79d682dbb31cd3a"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "6cb787ccbe19084202276387b1dc38ca"
server_key_iv: "1f41cce5c9e9370485a254946cc1974e"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.377399 12941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 17:33:23.378193 12956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.378440 12941 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:23.378548 12941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
uuid: "1c99553586a74095a79d682dbb31cd3a"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "6cb787ccbe19084202276387b1dc38ca"
server_key_iv: "1f41cce5c9e9370485a254946cc1974e"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.378630 12941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.396875 12941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.398732 12941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:23.398957 12941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.403313 12941 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.61:41699
I20260924 17:33:23.403350 13008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.61:41699 every 8 connection(s)
I20260924 17:33:23.403725 12941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
I20260924 17:33:23.404513 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 12941
I20260924 17:33:23.405046 13009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:23.407716 13009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.61@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:23.416326 13012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.405173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37134 (local address 127.6.37.61:41699)
0924 17:33:23.405406 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.405416 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.405451 (+ 35us) server_negotiation.cc:407] Connection header received
0924 17:33:23.406136 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.406143 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.406193 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.406306 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.407208 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.408135 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.409314 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.409849 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.409955 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.412871 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.412878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.412878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.412884 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.414557 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.415030 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.415033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.415034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.415122 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.415348 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.415349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.415350 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.415661 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.415798 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.415937 (+ 139us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.416071 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":145,"threads_started":1}
I20260924 17:33:23.416603 13013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.408372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:58842)
0924 17:33:23.408597 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.408643 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.408726 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.408959 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.408962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.409346 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.409436 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.409438 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.410305 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.410306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.411081 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.411084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.411681 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.411682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.411820 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.412280 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.412291 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.413812 (+ 1521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.415384 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.415391 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.415393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.415622 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.415854 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.415855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.415856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.415939 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.416257 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.416263 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.416328 (+ 65us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.416426 (+ 98us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.416533 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":146,"threads_started":1}
I20260924 17:33:23.416849 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.408453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58842 (local address 127.6.37.62:42529)
0924 17:33:23.408530 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.408532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.408717 (+ 185us) server_negotiation.cc:407] Connection header received
0924 17:33:23.408859 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.408860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.408870 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.408917 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.409536 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.410192 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.411168 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.411480 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.411563 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.413882 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.413883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.413884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.413892 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.415327 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.415718 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.415720 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.415721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.415782 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.416025 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.416026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.416026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.416187 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.416242 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.416664 (+ 422us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.416759 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260924 17:33:23.417443 13009 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.61@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
I20260924 17:33:23.424382 13013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.417861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.0.0.1:37136)
0924 17:33:23.417921 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.417931 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.417993 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.418135 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.418135 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.418242 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.418285 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.418286 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.419179 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.419180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.419768 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.419770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.420140 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.420141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.420244 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.420601 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.420605 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.421842 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.423260 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.423261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.423261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.423434 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.423700 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.423701 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.423701 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.423761 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.424028 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.424029 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.424067 (+ 38us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.424163 (+ 96us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.424263 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260924 17:33:23.424482 13012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.417927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37136 (local address 127.6.37.61:41699)
0924 17:33:23.418019 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.418021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.418033 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:33:23.418054 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.418054 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.418064 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.418130 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.418426 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.419083 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.419862 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.420050 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.420104 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.421927 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.421928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.421928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.421933 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.423168 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.423551 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.423552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.423553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.423615 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.423846 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.423847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.423847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.423954 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.424037 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.424188 (+ 151us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.424322 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":69}
I20260924 17:33:23.425916 13009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Bootstrap starting.
I20260924 17:33:23.426719 13009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:23.427060 13009 log.cc:824] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:23.427783 13009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: No bootstrap required, opened a new log
I20260924 17:33:23.429141 13009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } }
I20260924 17:33:23.429282 13009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:23.429332 13009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c99553586a74095a79d682dbb31cd3a, State: Initialized, Role: FOLLOWER
I20260924 17:33:23.429463 13009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } }
I20260924 17:33:23.429855 13009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:23.429880 13015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } } }
I20260924 17:33:23.429987 13015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: This master's current role is: FOLLOWER
W20260924 17:33:23.431697 13026 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:33:23.431759 13026 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:33:23.433418 12941 master_runner.cc:428] Detected that this master 1c99553586a74095a79d682dbb31cd3a is joining an existing cluster
I20260924 17:33:23.433497 12941 master_runner.cc:432] Initiating AddMaster RPC to add 127.6.37.61:41699
I20260924 17:33:23.441723 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.434561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58852 (local address 127.6.37.62:42529)
0924 17:33:23.434683 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.434686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.434764 (+ 78us) server_negotiation.cc:407] Connection header received
0924 17:33:23.434865 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.434866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.434917 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.434979 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.435371 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.436224 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.437096 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.437408 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.437479 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.438636 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.438637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.438637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.438647 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.440401 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.440894 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.440895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.440895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.440953 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.441173 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.441174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.441174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.441295 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.441378 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.441542 (+ 164us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.441621 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260924 17:33:23.441742 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.434504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:58852)
0924 17:33:23.434692 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.434705 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.434802 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.434985 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.434986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.435173 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.435265 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.435266 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.436315 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.436315 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.437001 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.437002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.437503 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.437504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.437569 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.438056 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.438061 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.438535 (+ 474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.440508 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.440509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.440509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.440799 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.441028 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.441029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.441030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.441092 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.441367 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.441368 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.441415 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.441513 (+ 98us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.441622 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":96,"threads_started":1}
I20260924 17:33:23.442591 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.434553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.0.0.1:37144)
0924 17:33:23.434740 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.434751 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.434819 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.435052 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.435052 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.435288 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.435350 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.435352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.436294 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.436295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.437172 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.437175 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.437618 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.437618 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.437688 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.438224 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.438230 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.438678 (+ 448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.440962 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.440962 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.440963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.441172 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.441408 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.441409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.441409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.441461 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.441729 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.441729 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.441765 (+ 36us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.442333 (+ 568us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.442447 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":81,"threads_started":1}
I20260924 17:33:23.442672 13012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.434710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37144 (local address 127.6.37.61:41699)
0924 17:33:23.434744 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.434746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.434812 (+ 66us) server_negotiation.cc:407] Connection header received
0924 17:33:23.434950 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.434951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.434959 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.434987 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.435412 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.436195 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.437256 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.437555 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.437617 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.438764 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.438765 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.438765 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.438772 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.440862 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.441257 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.441258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.441258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.441332 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.441531 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.441532 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.441532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.441642 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.441683 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.442400 (+ 717us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.442512 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":19}
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.62@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
I20260924 17:33:23.452033 13012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.444276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37146 (local address 127.6.37.61:41699)
0924 17:33:23.444313 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.444315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.444486 (+ 171us) server_negotiation.cc:407] Connection header received
0924 17:33:23.444583 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.444584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.444595 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.444644 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.445090 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.445636 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.446489 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.446707 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.446798 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.448941 (+ 2143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.448942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.448942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.448950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.450471 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.451087 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.451088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.451088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.451157 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.451412 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.451413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.451413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.451543 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.451627 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.451833 (+ 206us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.451914 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:33:23.452052 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.444204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.0.0.1:37146)
0924 17:33:23.444375 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.444419 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.444513 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.444659 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.444664 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.444947 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.444995 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.444996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.445730 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.445731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.446372 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.446374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.446809 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.446810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.446927 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.447422 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.447428 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.448847 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.450574 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.450582 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.450584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.450988 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.451248 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.451249 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.451249 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.451315 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.451619 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.451627 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.451684 (+ 57us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.451794 (+ 110us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.451926 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":84,"threads_started":1}
I20260924 17:33:23.452589 12475 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.6.37.61:41699: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1c99553586a74095a79d682dbb31cd3a"
member_type: NON_VOTER
last_known_addr {
host: "127.6.37.61"
port: 41699
}
attrs {
promote: true
}
}
dest_uuid: "c037a5d7cb484408a9e95ce76dc4ae63"
cas_config_opid_index: -1
I20260924 17:33:23.452980 12475 consensus_queue.cc:237] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } }
I20260924 17:33:23.453501 13036 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 1c99553586a74095a79d682dbb31cd3a (127.6.37.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } }
I20260924 17:33:23.453778 12983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:23.454771 13036 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.6.37.61:41699
I20260924 17:33:23.454890 12983 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Refusing update from remote peer c037a5d7cb484408a9e95ce76dc4ae63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260924 17:33:23.454982 13036 sys_catalog.cc:455] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } }
I20260924 17:33:23.455058 13036 sys_catalog.cc:458] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:23.455201 13036 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:23.455243 12941 master.cc:537] Master@127.6.37.61:41699 shutting down...
W20260924 17:33:23.456709 12459 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260924 17:33:23.457259 12459 consensus_peers.cc:487] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 -> Peer 1c99553586a74095a79d682dbb31cd3a (127.6.37.61:41699): Couldn't send request to peer 1c99553586a74095a79d682dbb31cd3a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260924 17:33:23.458597 12941 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:23.458689 12941 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:23.458735 12941 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: stopping tablet replica
I20260924 17:33:23.472036 12941 master.cc:552] Master@127.6.37.61:41699 shutdown complete.
I20260924 17:33:23.472081 12941 master_runner.cc:305] Clearing existing system tablet
I20260924 17:33:23.472256 12941 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.472298 12941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.473003 12941 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260924 17:33:23.473562 13041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.473682 12941 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.473743 12941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.473767 12941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
uuid: "1c99553586a74095a79d682dbb31cd3a"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "6cb787ccbe19084202276387b1dc38ca"
server_key_iv: "1f41cce5c9e9370485a254946cc1974e"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.474483 12941 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:23.476212 12941 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260924 17:33:23.476271 12941 log.cc:1196] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260924 17:33:23.476473 12941 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Deleting consensus metadata
I20260924 17:33:23.476599 12941 master_runner.cc:315] Copying system tablet from 127.6.37.62:42529
I20260924 17:33:23.477250 12941 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.37.62:42529
I20260924 17:33:23.483403 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.477638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58854 (local address 127.6.37.62:42529)
0924 17:33:23.477681 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.477683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.477806 (+ 123us) server_negotiation.cc:407] Connection header received
0924 17:33:23.477884 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.477885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.477896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.477953 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.478288 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.478799 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.479592 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.479803 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.479879 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.480823 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.480824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.480825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.480832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.482181 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.482557 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.482559 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.482559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.482617 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.482830 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.482831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.482831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.482992 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.483067 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.483223 (+ 156us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.483306 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:33:23.483415 13047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.477578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:58854)
0924 17:33:23.477736 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.477745 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.477822 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.477963 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.477964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.478141 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.478200 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.478202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.478928 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.478929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.479502 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.479504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.479878 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.479879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.479955 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.480458 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.480462 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.480734 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.482284 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.482285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.482286 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.482469 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.482694 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.482695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.482695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.482759 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.483059 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.483060 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.483107 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.483196 (+ 89us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.483303 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260924 17:33:23.483784 12496 tablet_copy_service.cc:140] P c037a5d7cb484408a9e95ce76dc4ae63: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1c99553586a74095a79d682dbb31cd3a ({username='oryx', principal='oryx/127.6.37.61@KRBTEST.COM'} at 127.0.0.1:58854)
I20260924 17:33:23.483963 12496 tablet_copy_service.cc:161] P c037a5d7cb484408a9e95ce76dc4ae63: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1c99553586a74095a79d682dbb31cd3a at {username='oryx', principal='oryx/127.6.37.61@KRBTEST.COM'} at 127.0.0.1:58854: session id = 1c99553586a74095a79d682dbb31cd3a-00000000000000000000000000000000
I20260924 17:33:23.484673 12496 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Tablet Copy: opened 0 blocks and 1 log segments
I20260924 17:33:23.485342 12941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260924 17:33:23.486256 12941 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: tablet copy: Starting download of 0 data blocks...
I20260924 17:33:23.486423 12941 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: tablet copy: Starting download of 1 WAL segments...
I20260924 17:33:23.487565 12941 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260924 17:33:23.488565 12496 tablet_copy_service.cc:342] P c037a5d7cb484408a9e95ce76dc4ae63: Request end of tablet copy session 1c99553586a74095a79d682dbb31cd3a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.6.37.61@KRBTEST.COM'} at 127.0.0.1:58854
I20260924 17:33:23.488629 12496 tablet_copy_service.cc:433] P c037a5d7cb484408a9e95ce76dc4ae63: ending tablet copy session 1c99553586a74095a79d682dbb31cd3a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1c99553586a74095a79d682dbb31cd3a
I20260924 17:33:23.491091 12941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.492287 13048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.492287 13049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.492411 13051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.492563 12941 server_base.cc:1034] running on GCE node
I20260924 17:33:23.492652 12941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.492802 12941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.493942 12941 hybrid_clock.cc:648] HybridClock initialized: now 1790271203493936 us; error 44 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.495326 12941 init.cc:377] Logged in from keytab as oryx/127.6.37.61@KRBTEST.COM (short username oryx)
I20260924 17:33:23.495610 12941 webserver.cc:460] Webserver started at http://127.6.37.61:40567/ using document root <none> and password file <none>
I20260924 17:33:23.495728 12941 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.495784 12941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.496491 12941 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:23.497012 13058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.497129 12941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:23.497176 12941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
uuid: "1c99553586a74095a79d682dbb31cd3a"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "6cb787ccbe19084202276387b1dc38ca"
server_key_iv: "1f41cce5c9e9370485a254946cc1974e"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.497231 12941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.510098 12941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.511725 12941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.514829 12941 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.61:41699
I20260924 17:33:23.515159 13110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.61:41699 every 8 connection(s)
I20260924 17:33:23.515234 12941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
I20260924 17:33:23.515960 13111 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:33:23.516625 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Bootstrap starting.
I20260924 17:33:23.519680 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:33:23.519950 13111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: Bootstrap complete.
I20260924 17:33:23.520165 13111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } }
I20260924 17:33:23.520269 13111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1c99553586a74095a79d682dbb31cd3a, State: Initialized, Role: LEARNER
I20260924 17:33:23.520323 13111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } }
I20260924 17:33:23.520524 13111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:23.522125 13126 catalog_manager.cc:1259] Loaded cluster ID: 38d120ce539644a98e518a32a096c4e4
I20260924 17:33:23.522199 13126 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: loading cluster ID for follower catalog manager: success
I20260924 17:33:23.523286 13126 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: acquiring CA information for follower catalog manager: success
I20260924 17:33:23.523379 13115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } }
I20260924 17:33:23.523512 13115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: This master's current role is: LEARNER
I20260924 17:33:23.523725 13126 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 17:33:23.526909 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.518081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37170 (local address 127.6.37.61:41699)
0924 17:33:23.518291 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.518293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.518301 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:23.518324 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.518325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.518337 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.519193 (+ 856us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.519228 (+ 35us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.520497 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.521646 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.522565 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.522864 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.524095 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.524096 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.524097 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.524103 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.525452 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.526058 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.526059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.526059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.526124 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.526358 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.526359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.526359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.526472 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.526579 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.526677 (+ 98us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.526769 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for oryx/127.6.37.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.60.keytab.
Entry for principal oryx/127.6.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.60.keytab.
I20260924 17:33:23.554764 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:42735
--webserver_interface=127.6.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.60.keytab
--principal=oryx/127.6.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:23.638711 13129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:23.638976 13129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:23.639017 13129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:23.640184 13129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:23.640255 13129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:23.640280 13129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:23.640301 13129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:23.640332 13129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:23.641798 13129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.60.keytab
--principal=oryx/127.6.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:42735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.6.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:23.642066 13129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:23.642292 13129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.647202 13135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.647221 13137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.647202 13134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.647466 13129 server_base.cc:1034] running on GCE node
I20260924 17:33:23.647683 13129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.647938 13129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.649088 13129 hybrid_clock.cc:648] HybridClock initialized: now 1790271203649075 us; error 28 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.652122 13129 init.cc:377] Logged in from keytab as oryx/127.6.37.60@KRBTEST.COM (short username oryx)
I20260924 17:33:23.652551 13129 webserver.cc:460] Webserver started at http://127.6.37.60:37397/ using document root <none> and password file <none>
I20260924 17:33:23.652771 13129 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.652838 13129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.652972 13129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:23.654044 13129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/instance:
uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "9e63d5139a73789cb535604fdb7cd0a6"
server_key_iv: "1fde85e6a9600e4ce6dadd37828168fc"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.654443 13129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal/instance:
uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "9e63d5139a73789cb535604fdb7cd0a6"
server_key_iv: "1fde85e6a9600e4ce6dadd37828168fc"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.655900 13129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:33:23.656600 13144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.656770 13129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:33:23.656909 13129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "9e63d5139a73789cb535604fdb7cd0a6"
server_key_iv: "1fde85e6a9600e4ce6dadd37828168fc"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.656984 13129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.674021 13129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.675901 13129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:23.676051 13129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.680310 13129 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.60:42735
I20260924 17:33:23.680356 13196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.60:42735 every 8 connection(s)
I20260924 17:33:23.680706 13129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
I20260924 17:33:23.681619 13197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:23.683117 13197 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.60@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:23.690160 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 13129
I20260924 17:33:23.693796 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.684017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58866 (local address 127.6.37.62:42529)
0924 17:33:23.684064 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.684066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.684168 (+ 102us) server_negotiation.cc:407] Connection header received
0924 17:33:23.684595 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.684596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.684606 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.684656 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.685231 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.685734 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.686800 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.687060 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.687116 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.690199 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.690201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.690201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.690209 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.692098 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.692606 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.692607 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.692608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.692703 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.693003 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.693004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.693005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.693167 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.693237 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.693573 (+ 336us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.693692 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:23.693969 13199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.683812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:58866)
0924 17:33:23.684026 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.684077 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.684512 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.684706 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.684709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.684950 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.685157 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.685161 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.685810 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.685811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.686710 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.686713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.687136 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.687137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.687267 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.687908 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.687919 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.690073 (+ 2154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.692193 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.692198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.692201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.692501 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.692775 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.692776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.692776 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.692906 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.693230 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.693235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.693392 (+ 157us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.693533 (+ 141us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.693754 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":93,"threads_started":1}
I20260924 17:33:23.694733 13197 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.6.37.60@KRBTEST.COM
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.60@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
I20260924 17:33:23.700613 13200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.690633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53832 (local address 127.6.37.60:42735)
0924 17:33:23.690851 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.690856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.690890 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:33:23.690911 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.690912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.690925 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.690996 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.691927 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.692952 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.694019 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.694482 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.694581 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.697219 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.697227 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.697227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.697234 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.699294 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.699722 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.699725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.699726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.699786 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.700014 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.700014 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.700015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.700141 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.700404 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.700453 (+ 49us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.700533 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":105,"threads_started":1}
I20260924 17:33:23.702262 13199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.695314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.0.0.1:37180)
0924 17:33:23.695365 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.695374 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.695409 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.695572 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.695572 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.695704 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.695748 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.695749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.696414 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.696415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.697075 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.697077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.697459 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.697460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.697537 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.697938 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.697942 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.699337 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.701375 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.701376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.701377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.701545 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.701756 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.701756 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.701757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.701841 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.702058 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.702059 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.702091 (+ 32us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.702139 (+ 48us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.702205 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260924 17:33:23.702275 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.695400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37180 (local address 127.6.37.61:41699)
0924 17:33:23.695452 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.695455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.695463 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:23.695485 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.695486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.695497 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.695570 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.695835 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.696315 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.697153 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.697375 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.697458 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.699409 (+ 1951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.699410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.699411 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.699419 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.701215 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.701634 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.701635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.701635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.701698 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.701897 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.701898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.701898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.702002 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.702051 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.702154 (+ 103us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.702215 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:23.702762 13197 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 42735 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.60@KRBTEST.COM for oryx/127.6.37.60@KRBTEST.COM
I20260924 17:33:23.708636 13199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.703025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:42735 (local address 127.0.0.1:53840)
0924 17:33:23.703074 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.703085 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.703124 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.703236 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.703237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.703340 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.703368 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.703369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.703897 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.703898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.704344 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.704345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.704681 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.704682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.704721 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.705123 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.705127 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.706174 (+ 1047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.707786 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.707787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.707787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.707976 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.708174 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.708175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.708175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.708222 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.708428 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.708429 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.708460 (+ 31us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.708510 (+ 50us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.708583 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260924 17:33:23.708793 13200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.703080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53840 (local address 127.6.37.60:42735)
0924 17:33:23.703131 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.703132 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.703141 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:23.703185 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.703185 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.703193 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.703234 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.703410 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.703839 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.704436 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.704621 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.704669 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.706294 (+ 1625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.706296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.706296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.706303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.707701 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.708057 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.708058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.708058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.708112 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.708269 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.708269 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.708270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.708375 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.708429 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.708530 (+ 101us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.708634 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":32}
I20260924 17:33:23.710081 13197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Bootstrap starting.
I20260924 17:33:23.711112 13197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:23.711437 13197 log.cc:824] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:23.712203 13197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: No bootstrap required, opened a new log
I20260924 17:33:23.713879 13197 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 42735 } }
I20260924 17:33:23.714044 13197 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:23.714102 13197 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2fcd0e434c54ab696a4c2af7bce2d4b, State: Initialized, Role: FOLLOWER
I20260924 17:33:23.714291 13197 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 42735 } }
I20260924 17:33:23.714689 13197 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:23.714648 13202 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 42735 } } }
I20260924 17:33:23.714848 13202 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [sys.catalog]: This master's current role is: FOLLOWER
W20260924 17:33:23.716619 13213 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:33:23.716668 13213 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:33:23.719269 13129 master_runner.cc:428] Detected that this master d2fcd0e434c54ab696a4c2af7bce2d4b is joining an existing cluster
I20260924 17:33:23.719318 13129 master_runner.cc:432] Initiating AddMaster RPC to add 127.6.37.60:42735
I20260924 17:33:23.727474 13219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.720575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.0.0.1:37188)
0924 17:33:23.720745 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.720755 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.720812 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.721003 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.721004 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.721215 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.721301 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.721303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.722338 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.722339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.723284 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.723286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.723809 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.723809 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.723869 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.724359 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.724364 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.724783 (+ 419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.726391 (+ 1608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.726393 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.726393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.726628 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.726803 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.726803 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.726804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.726866 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.727145 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.727146 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.727192 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.727276 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.727373 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":112,"threads_started":1}
I20260924 17:33:23.727599 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.720646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37188 (local address 127.6.37.61:41699)
0924 17:33:23.720704 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.720706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.720813 (+ 107us) server_negotiation.cc:407] Connection header received
0924 17:33:23.720875 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.720875 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.720886 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.720954 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.721390 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.722217 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.723381 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.723672 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.723714 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.724869 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.724870 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.724870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.724876 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.726313 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.726700 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.726701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.726701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.726747 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.726944 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.726945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.726945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.727072 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.727136 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.727386 (+ 250us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.727467 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:33:23.747190 13221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.721262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:42735 (local address 127.0.0.1:53846)
0924 17:33:23.721377 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.721385 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.721486 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.721690 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.721690 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.721867 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.721916 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.721918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.722779 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.722780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.723708 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.723711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.724173 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.724174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.724233 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.743521 (+ 19288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.743527 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.744013 (+ 486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.745846 (+ 1833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.745848 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.745848 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.746103 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.746449 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746450 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.746450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.746509 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.746767 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.746768 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.746816 (+ 48us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.746961 (+ 145us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.747072 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":38,"thread_start_us":66,"threads_started":1}
I20260924 17:33:23.747274 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.720871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58868 (local address 127.6.37.62:42529)
0924 17:33:23.720911 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.720913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.721135 (+ 222us) server_negotiation.cc:407] Connection header received
0924 17:33:23.721273 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.721274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.721286 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.721318 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.721830 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.722659 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.723804 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.724109 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.724147 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.744283 (+ 20136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.744285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.744286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.744295 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.745919 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746304 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.746305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.746306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.746364 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746548 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.746549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.746550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.746699 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.746766 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.747109 (+ 343us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.747184 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:33:23.747478 13220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.720930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:58868)
0924 17:33:23.721081 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.721090 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.721194 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.721387 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.721387 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.721675 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.721742 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.721744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.722750 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.722751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.723709 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.723711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.724214 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.724214 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.724290 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.743701 (+ 19411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.743706 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.744187 (+ 481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.746011 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746012 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.746013 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.746230 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.746432 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746432 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.746432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.746478 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.746948 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.746949 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.747000 (+ 51us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.747071 (+ 71us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.747175 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":74,"thread_start_us":113,"threads_started":1}
I20260924 17:33:23.747776 13200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.721194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53846 (local address 127.6.37.60:42735)
0924 17:33:23.721240 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.721242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.721424 (+ 182us) server_negotiation.cc:407] Connection header received
0924 17:33:23.721593 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.721594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.721617 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.721641 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.721985 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.722705 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.723800 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.724067 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.724103 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.744134 (+ 20031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.744136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.744136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.744143 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.745752 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746178 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.746179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.746180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.746230 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.746587 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.746587 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.746588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.746698 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.746766 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.746989 (+ 223us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.747707 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":626,"server-negotiator.queue_time_us":30}
I20260924 17:33:23.751946 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12538
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271202, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.62@KRBTEST.COM for oryx/127.6.37.60@KRBTEST.COM
I20260924 17:33:23.759070 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:45869
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:42529
--webserver_port=46625
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:33:23.760085 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.749656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:42735 (local address 127.0.0.1:53862)
0924 17:33:23.749713 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.749725 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.749770 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.749916 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.749917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.750101 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.750149 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.750150 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.750831 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.750832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.751704 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.751707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.755181 (+ 3474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.755182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.755267 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.755654 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.755659 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.757220 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.758989 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.758990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.758990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.759192 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.759375 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.759376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.759376 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.759427 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.759696 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.759697 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.759738 (+ 41us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.759865 (+ 127us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.759981 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260924 17:33:23.760412 13200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.749715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53862 (local address 127.6.37.60:42735)
0924 17:33:23.749758 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.749760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.749767 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:33:23.749839 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.749840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.749848 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.749892 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.750257 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.750759 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.751784 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.755097 (+ 3313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.755168 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.757306 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.757308 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.757308 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.757315 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.758890 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.759265 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.759266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.759266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.759314 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.759500 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.759501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.759502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.759617 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.759672 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.760260 (+ 588us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.760330 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:33:23.760838 12475 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.6.37.60:42735: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b"
member_type: NON_VOTER
last_known_addr {
host: "127.6.37.60"
port: 42735
}
attrs {
promote: true
}
}
dest_uuid: "c037a5d7cb484408a9e95ce76dc4ae63"
cas_config_opid_index: 5
I20260924 17:33:23.761102 12475 consensus_queue.cc:237] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:23.761490 13036 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d2fcd0e434c54ab696a4c2af7bce2d4b (127.6.37.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.761890 13171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:23.762548 13036 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.6.37.60:42735
I20260924 17:33:23.762624 13036 sys_catalog.cc:455] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.762705 13036 sys_catalog.cc:458] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:23.762809 13171 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 1 FOLLOWER]: Refusing update from remote peer c037a5d7cb484408a9e95ce76dc4ae63: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260924 17:33:23.763213 13037 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:23.763685 13129 master.cc:537] Master@127.6.37.60:42735 shutting down...
W20260924 17:33:23.765489 12461 consensus_peers.cc:487] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 -> Peer d2fcd0e434c54ab696a4c2af7bce2d4b (127.6.37.60:42735): Couldn't send request to peer d2fcd0e434c54ab696a4c2af7bce2d4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260924 17:33:23.766633 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.761539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.0.0.1:37190)
0924 17:33:23.763084 (+ 1545us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.763094 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.763135 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.763334 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.763334 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.763336 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:23.763371 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.763373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.764284 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.764285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.765502 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.765505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.766394 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.766395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.766460 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.766480 (+ 20us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.766529 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.766565 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1529}
I20260924 17:33:23.766888 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.761632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37190 (local address 127.6.37.61:41699)
0924 17:33:23.763053 (+ 1421us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.763055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.763184 (+ 129us) server_negotiation.cc:407] Connection header received
0924 17:33:23.763208 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.763209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.763230 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.763284 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:23.763438 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.764192 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.765611 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.766210 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.766258 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.766332 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.766762 (+ 430us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.766804 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1393}
I20260924 17:33:23.767093 13085 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 LEARNER]: Refusing update from remote peer c037a5d7cb484408a9e95ce76dc4ae63: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260924 17:33:23.767464 13037 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260924 17:33:23.768088 13085 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d2fcd0e434c54ab696a4c2af7bce2d4b (127.6.37.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.769170 13115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c037a5d7cb484408a9e95ce76dc4ae63. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.769259 13115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: This master's current role is: LEARNER
I20260924 17:33:23.769202 13224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: NON_VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: true } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.769443 13224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: This master's current role is: LEARNER
I20260924 17:33:23.769513 13129 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:23.769618 13129 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:23.769671 13129 tablet_replica.cc:330] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: stopping tablet replica
I20260924 17:33:23.770228 13037 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: attempting to promote NON_VOTER 1c99553586a74095a79d682dbb31cd3a to VOTER
I20260924 17:33:23.770421 13037 consensus_queue.cc:237] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:23.770900 13085 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 LEARNER]: Refusing update from remote peer c037a5d7cb484408a9e95ce76dc4ae63: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260924 17:33:23.771011 12461 consensus_peers.cc:487] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 -> Peer d2fcd0e434c54ab696a4c2af7bce2d4b (127.6.37.60:42735): Couldn't send request to peer d2fcd0e434c54ab696a4c2af7bce2d4b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260924 17:33:23.771086 13036 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260924 17:33:23.771620 13036 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1c99553586a74095a79d682dbb31cd3a (127.6.37.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.772431 13036 sys_catalog.cc:455] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.772509 13036 sys_catalog.cc:458] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:23.772557 13036 sys_catalog.cc:455] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.772604 13036 sys_catalog.cc:458] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63 [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:23.772832 13085 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 1c99553586a74095a79d682dbb31cd3a (127.6.37.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.773695 13224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.773770 13224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:33:23.783753 13129 master.cc:552] Master@127.6.37.60:42735 shutdown complete.
I20260924 17:33:23.783807 13129 master_runner.cc:305] Clearing existing system tablet
I20260924 17:33:23.783934 13129 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.783979 13129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.784682 13129 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.000s
I20260924 17:33:23.785218 13226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.785359 13129 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.785420 13129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.785442 13129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "9e63d5139a73789cb535604fdb7cd0a6"
server_key_iv: "1fde85e6a9600e4ce6dadd37828168fc"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.786178 13129 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:23.787928 13129 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260924 17:33:23.787998 13129 log.cc:1196] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260924 17:33:23.788183 13129 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Deleting consensus metadata
I20260924 17:33:23.788303 13129 master_runner.cc:315] Copying system tablet from 127.6.37.62:42529
I20260924 17:33:23.788911 13129 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: tablet copy: Beginning tablet copy session from remote peer at address 127.6.37.62:42529
I20260924 17:33:23.796097 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.789275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58872 (local address 127.6.37.62:42529)
0924 17:33:23.789320 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.789323 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.789383 (+ 60us) server_negotiation.cc:407] Connection header received
0924 17:33:23.789454 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.789455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.789465 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.789563 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.789892 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.790660 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.791713 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.792004 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.792068 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.793180 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.793182 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.793182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.793191 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.794914 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.795291 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.795292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.795293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.795355 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.795567 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.795567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.795568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.795699 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.795767 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.795929 (+ 162us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.796008 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:23.796099 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.789197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:58872)
0924 17:33:23.789324 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.789335 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.789399 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.789569 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.789570 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.789764 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.789810 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.789812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.790760 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.790761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.791609 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.791612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.792087 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.792088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.792149 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.792661 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.792667 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.793081 (+ 414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.794995 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.794997 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.794997 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.795216 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.795429 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.795430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.795431 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.795497 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.795770 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.795771 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.795818 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.795891 (+ 73us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.795998 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
I20260924 17:33:23.796748 12496 tablet_copy_service.cc:140] P c037a5d7cb484408a9e95ce76dc4ae63: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d2fcd0e434c54ab696a4c2af7bce2d4b ({username='oryx', principal='oryx/127.6.37.60@KRBTEST.COM'} at 127.0.0.1:58872)
I20260924 17:33:23.796811 12496 tablet_copy_service.cc:161] P c037a5d7cb484408a9e95ce76dc4ae63: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d2fcd0e434c54ab696a4c2af7bce2d4b at {username='oryx', principal='oryx/127.6.37.60@KRBTEST.COM'} at 127.0.0.1:58872: session id = d2fcd0e434c54ab696a4c2af7bce2d4b-00000000000000000000000000000000
I20260924 17:33:23.797417 12496 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Tablet Copy: opened 0 blocks and 1 log segments
I20260924 17:33:23.797834 13129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260924 17:33:23.799180 13129 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: tablet copy: Starting download of 0 data blocks...
I20260924 17:33:23.799371 13129 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: tablet copy: Starting download of 1 WAL segments...
I20260924 17:33:23.800087 13129 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260924 17:33:23.800957 12496 tablet_copy_service.cc:342] P c037a5d7cb484408a9e95ce76dc4ae63: Request end of tablet copy session d2fcd0e434c54ab696a4c2af7bce2d4b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.6.37.60@KRBTEST.COM'} at 127.0.0.1:58872
I20260924 17:33:23.801012 12496 tablet_copy_service.cc:433] P c037a5d7cb484408a9e95ce76dc4ae63: ending tablet copy session d2fcd0e434c54ab696a4c2af7bce2d4b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d2fcd0e434c54ab696a4c2af7bce2d4b
I20260924 17:33:23.803754 13129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.804881 13233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.804906 13236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.805302 13129 server_base.cc:1034] running on GCE node
W20260924 17:33:23.807030 13234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.807176 13129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.807329 13129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.808462 13129 hybrid_clock.cc:648] HybridClock initialized: now 1790271203808438 us; error 46 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.810006 13129 init.cc:377] Logged in from keytab as oryx/127.6.37.60@KRBTEST.COM (short username oryx)
I20260924 17:33:23.810273 13129 webserver.cc:460] Webserver started at http://127.6.37.60:38415/ using document root <none> and password file <none>
I20260924 17:33:23.810395 13129 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.810433 13129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.811198 13129 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:23.811792 13243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.811959 13129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:33:23.812016 13129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "9e63d5139a73789cb535604fdb7cd0a6"
server_key_iv: "1fde85e6a9600e4ce6dadd37828168fc"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.812080 13129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.820003 13129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.821707 13129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.824751 13129 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.60:42735
I20260924 17:33:23.825112 13129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
I20260924 17:33:23.827049 13295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.60:42735 every 8 connection(s)
I20260924 17:33:23.827823 13296 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:33:23.828330 13296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Bootstrap starting.
I20260924 17:33:23.831363 13296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:33:23.831607 13296 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: Bootstrap complete.
I20260924 17:33:23.831801 13296 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:23.831898 13296 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d2fcd0e434c54ab696a4c2af7bce2d4b, State: Initialized, Role: LEARNER
I20260924 17:33:23.831951 13296 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:23.832145 13296 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:23.832139 13299 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } } }
I20260924 17:33:23.832393 13299 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b [sys.catalog]: This master's current role is: LEARNER
I20260924 17:33:23.833606 13310 catalog_manager.cc:1259] Loaded cluster ID: 38d120ce539644a98e518a32a096c4e4
I20260924 17:33:23.833688 13310 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: loading cluster ID for follower catalog manager: success
I20260924 17:33:23.835083 13310 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: acquiring CA information for follower catalog manager: success
I20260924 17:33:23.835371 13310 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d2fcd0e434c54ab696a4c2af7bce2d4b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260924 17:33:23.858114 13222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:23.858299 13222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:23.858321 13222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:23.859511 13222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:23.859552 13222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:23.859578 13222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:23.861019 13222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:45869
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=46625
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:23.861246 13222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:23.861483 13222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:23.867349 13316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.867405 13315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:23.867422 13318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:23.868314 13222 server_base.cc:1034] running on GCE node
I20260924 17:33:23.868512 13222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:23.868775 13222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:23.869930 13222 hybrid_clock.cc:648] HybridClock initialized: now 1790271203869905 us; error 42 us; skew 500 ppm
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:23.872485 13222 init.cc:377] Logged in from keytab as oryx/127.6.37.1@KRBTEST.COM (short username oryx)
I20260924 17:33:23.872988 13222 webserver.cc:460] Webserver started at http://127.6.37.1:46625/ using document root <none> and password file <none>
I20260924 17:33:23.873227 13222 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:23.873306 13222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:23.874696 13222 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:23.875391 13325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.875583 13222 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260924 17:33:23.875680 13222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "6e988d5858a244408d25821580b7a548"
format_stamp: "Formatted at 2026-09-24 17:33:22 on dist-test-slave-gcz9"
server_key: "95ca42b6f7a0bccb5d1b5f00db49e54d"
server_key_iv: "56e2a4fa1784baa186433e5413674335"
server_key_version: "encryptionkey@0"
I20260924 17:33:23.876044 13222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:23.889734 13222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:23.892015 13222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:23.892175 13222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:23.892407 13222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:23.892712 13222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:23.892766 13222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.892808 13222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:23.892836 13222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:23.900638 13222 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:45869
I20260924 17:33:23.900682 13438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:45869 every 8 connection(s)
I20260924 17:33:23.901058 13222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:33:23.904855 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 13222
I20260924 17:33:23.905021 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12673
I20260924 17:33:23.911629 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:37129
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:42529
--webserver_port=42123
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.60@KRBTEST.COM
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
Sep 24 17:33:23 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271203, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:23.917588 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.902013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:54693 (local address 127.6.37.61:41699)
0924 17:33:23.902056 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.902058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.902344 (+ 286us) server_negotiation.cc:407] Connection header received
0924 17:33:23.903813 (+ 1469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.903815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.903828 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.903890 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.904721 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.905388 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.910575 (+ 5187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.910909 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.910953 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.914601 (+ 3648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.914603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.914603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.914612 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.916315 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916703 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.916704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.916704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.916756 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916956 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.916957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.916957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.917108 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.917148 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.917404 (+ 256us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.917499 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:23.917760 13446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.902311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:42735 (local address 127.6.37.1:53013)
0924 17:33:23.903303 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.903311 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.903714 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.904086 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.904087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.904535 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.909060 (+ 4525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.909063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.910368 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.910369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.911274 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.911276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.911780 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.911781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.911868 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.912368 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.912373 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.914007 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.916116 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916124 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.916127 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.916433 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.916639 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.916640 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.916768 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.917080 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.917086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.917252 (+ 166us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.917353 (+ 101us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.917519 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"mutex_wait_us":6,"thread_start_us":220,"threads_started":1}
I20260924 17:33:23.917901 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.901797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.6.37.1:54693)
0924 17:33:23.902181 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.902223 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.903698 (+ 1475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.903974 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.903979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.904366 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.904604 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.904611 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.909156 (+ 4545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.909156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.910475 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.910477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.911042 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.911043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.911212 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.912104 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.912115 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.914474 (+ 2359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.916401 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916401 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.916402 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.916621 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.916830 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.916831 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.916883 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.917191 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.917191 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.917252 (+ 61us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.917719 (+ 467us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.917812 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":703,"threads_started":1}
I20260924 17:33:23.918179 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.902421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:53013 (local address 127.6.37.60:42735)
0924 17:33:23.903017 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.903019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.903368 (+ 349us) server_negotiation.cc:407] Connection header received
0924 17:33:23.903949 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.903951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.903964 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.904054 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.909196 (+ 5142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.910274 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.911368 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.911649 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.911715 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.914108 (+ 2393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.914110 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.914110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.914118 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.916021 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916512 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.916513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.916513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.916573 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.916841 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.916842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.916842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.916994 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.917054 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.918009 (+ 955us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.918091 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":77,"threads_started":1}
I20260924 17:33:23.918478 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.901941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:44457 (local address 127.6.37.62:42529)
0924 17:33:23.902021 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:23.902023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:23.903212 (+ 1189us) server_negotiation.cc:407] Connection header received
0924 17:33:23.903813 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:23.903815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:23.903829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:23.903862 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:23.909219 (+ 5357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.910051 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.911211 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.911946 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.911994 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.915160 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:23.915162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:23.915162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:23.915170 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:23.917126 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.917567 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.917568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.917569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.917627 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:23.917824 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:23.917825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:23.917825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:23.917944 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:23.918000 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:23.918293 (+ 293us) server_negotiation.cc:299] Negotiation successful
0924 17:33:23.918373 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260924 17:33:23.918952 13441 heartbeater.cc:347] Connected to a master server at 127.6.37.61:41699
I20260924 17:33:23.918963 13439 heartbeater.cc:347] Connected to a master server at 127.6.37.60:42735
I20260924 17:33:23.919061 13441 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:23.919063 13439 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:23.919220 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:23.901798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:44457)
0924 17:33:23.903134 (+ 1336us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:23.903143 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:23.903714 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:23.903978 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:23.903980 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:23.904536 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:23.909110 (+ 4574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.909114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.910152 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.910153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.911122 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:23.911126 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:23.912074 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:23.912075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:23.912399 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:23.912806 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:23.912811 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:23.915059 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:23.917229 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.917230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.917231 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.917462 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.917701 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:23.917702 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:23.917703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:23.917762 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:23.918039 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:23.918040 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:23.918091 (+ 51us) client_negotiation.cc:769] Sending connection context
0924 17:33:23.918974 (+ 883us) client_negotiation.cc:240] Negotiation successful
0924 17:33:23.919082 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1301,"mutex_wait_us":37,"thread_start_us":164,"threads_started":1}
I20260924 17:33:23.919265 13441 heartbeater.cc:511] Master 127.6.37.61:41699 requested a full tablet report, sending...
I20260924 17:33:23.919276 13439 heartbeater.cc:511] Master 127.6.37.60:42735 requested a full tablet report, sending...
I20260924 17:33:23.919976 13075 ts_manager.cc:194] Registered new tserver with Master: 6e988d5858a244408d25821580b7a548 (127.6.37.1:45869)
I20260924 17:33:23.920265 13440 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42529
I20260924 17:33:23.920320 13440 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:23.920409 13440 heartbeater.cc:511] Master 127.6.37.62:42529 requested a full tablet report, sending...
I20260924 17:33:23.920440 13260 ts_manager.cc:194] Registered new tserver with Master: 6e988d5858a244408d25821580b7a548 (127.6.37.1:45869)
I20260924 17:33:23.920710 12475 ts_manager.cc:194] Re-registered known tserver with Master: 6e988d5858a244408d25821580b7a548 (127.6.37.1:45869)
I20260924 17:33:23.921144 12475 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:44457
W20260924 17:33:23.998569 13447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:23.998757 13447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:23.998780 13447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:23.999925 13447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:23.999966 13447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:23.999991 13447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:24.001333 13447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:37129
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=42123
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:24.001533 13447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:24.001706 13447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:24.006594 13456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:24.006608 13447 server_base.cc:1034] running on GCE node
W20260924 17:33:24.006588 13454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:24.006587 13453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:24.006959 13447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:24.007200 13447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:24.008383 13447 hybrid_clock.cc:648] HybridClock initialized: now 1790271204008375 us; error 38 us; skew 500 ppm
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:24.010970 13447 init.cc:377] Logged in from keytab as oryx/127.6.37.2@KRBTEST.COM (short username oryx)
I20260924 17:33:24.011405 13447 webserver.cc:460] Webserver started at http://127.6.37.2:42123/ using document root <none> and password file <none>
I20260924 17:33:24.011642 13447 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:24.011722 13447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:24.013178 13447 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:24.013746 13463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.013948 13447 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.014019 13447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "90fbeebd5ec54841b818e8e3aea9aaee"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ef9f58ca843c6ef1a4d2b7045e3678ea"
server_key_iv: "9b42d3786db92572fa09320e2a585a76"
server_key_version: "encryptionkey@0"
I20260924 17:33:24.014396 13447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:24.035719 13447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:24.037632 13447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:24.037786 13447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:24.038038 13447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:24.038363 13447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:24.038398 13447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.038420 13447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:24.038434 13447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.044854 13447 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:37129
I20260924 17:33:24.044916 13576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:37129 every 8 connection(s)
I20260924 17:33:24.045269 13447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:24.048399 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 13447
I20260924 17:33:24.048568 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12807
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
I20260924 17:33:24.055984 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:38763
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:42529
--webserver_port=39411
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.60@KRBTEST.COM
I20260924 17:33:24.058780 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.046533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:40999 (local address 127.6.37.62:42529)
0924 17:33:24.046597 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.046598 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.046608 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:24.047322 (+ 714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.047323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.047337 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.047389 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.048267 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.048972 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.051173 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.051545 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.051613 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.054677 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.054679 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.054679 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.054687 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.057240 (+ 2553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.057885 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.057886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.057886 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.057956 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.058171 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.058172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.058172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.058303 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.058344 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.058567 (+ 223us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.058655 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260924 17:33:24.058982 13581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.046078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.6.37.2:50967)
0924 17:33:24.046344 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.046389 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.047106 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.047445 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.047450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.048028 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:24.048234 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.048235 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.049846 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.049847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.051200 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.051203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.051769 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.051770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.051917 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.052573 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:24.052578 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:24.054761 (+ 2183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:24.057117 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.057125 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.057127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.057457 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.057680 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.057681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.057681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.057817 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.058163 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:24.058171 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:24.058335 (+ 164us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.058453 (+ 118us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.058627 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":29,"thread_start_us":92,"threads_started":1}
I20260924 17:33:24.059374 13583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.046390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:40999)
0924 17:33:24.046564 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.046574 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.047118 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.047735 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.047736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.047962 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:24.048166 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.048170 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.049242 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.049244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.051070 (+ 1826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.051073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.051690 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.051691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.051867 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.052407 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:24.052418 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:24.054571 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:24.057323 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.057324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.057324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.057527 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.058042 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.058042 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.058043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.058104 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.058392 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:24.058393 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:24.058453 (+ 60us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.058946 (+ 493us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.059045 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":80,"threads_started":1}
I20260924 17:33:24.059403 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.046454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:50967 (local address 127.6.37.61:41699)
0924 17:33:24.046506 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.046508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.046518 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:24.047242 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.047244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.047257 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.047289 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.048352 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.049133 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.051295 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.051643 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.051689 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.054900 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.054901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.054902 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.054910 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.056969 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.057548 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.057549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.057550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.057608 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.057903 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.057904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.057904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.058055 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.058133 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.059223 (+ 1090us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.059301 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260924 17:33:24.059770 13578 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42529
I20260924 17:33:24.059795 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.046226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:57479 (local address 127.6.37.60:42735)
0924 17:33:24.046328 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.046330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.046514 (+ 184us) server_negotiation.cc:407] Connection header received
0924 17:33:24.047236 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.047238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.047255 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.047352 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.051746 (+ 4394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.053012 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.054048 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.054427 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.054496 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.056714 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.056715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.056716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.056723 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.058497 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.058843 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.058844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.058845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.058922 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.059204 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.059205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.059205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.059338 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.059390 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.059580 (+ 190us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.059669 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260924 17:33:24.059873 13579 heartbeater.cc:347] Connected to a master server at 127.6.37.61:41699
I20260924 17:33:24.059878 13578 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:24.059934 13579 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:24.060110 13579 heartbeater.cc:511] Master 127.6.37.61:41699 requested a full tablet report, sending...
I20260924 17:33:24.060111 13578 heartbeater.cc:511] Master 127.6.37.62:42529 requested a full tablet report, sending...
I20260924 17:33:24.060528 12475 ts_manager.cc:194] Re-registered known tserver with Master: 90fbeebd5ec54841b818e8e3aea9aaee (127.6.37.2:37129)
I20260924 17:33:24.060587 13075 ts_manager.cc:194] Registered new tserver with Master: 90fbeebd5ec54841b818e8e3aea9aaee (127.6.37.2:37129)
I20260924 17:33:24.060638 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.046078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:42735 (local address 127.6.37.2:57479)
0924 17:33:24.046447 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.046458 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.047116 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.047445 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.047450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.048029 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:24.048181 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.048184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.053116 (+ 4932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.053117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.053963 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.053965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.054597 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.054598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.054674 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.055153 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:24.055158 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:24.056615 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:24.058574 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.058575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.058576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.058760 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.059033 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.059033 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.059034 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.059096 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.059425 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:24.059426 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:24.059465 (+ 39us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.059939 (+ 474us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.060037 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":7,"thread_start_us":84,"threads_started":1}
I20260924 17:33:24.060941 13577 heartbeater.cc:347] Connected to a master server at 127.6.37.60:42735
I20260924 17:33:24.060979 13577 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:24.061034 13577 heartbeater.cc:511] Master 127.6.37.60:42735 requested a full tablet report, sending...
I20260924 17:33:24.061038 12475 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:40999
I20260924 17:33:24.061311 13260 ts_manager.cc:194] Registered new tserver with Master: 90fbeebd5ec54841b818e8e3aea9aaee (127.6.37.2:37129)
W20260924 17:33:24.142565 13584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:24.142858 13584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:24.142900 13584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:24.144052 13584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:24.144121 13584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:24.144170 13584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:24.145709 13584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:38763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=39411
--tserver_master_addrs=127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:24.145982 13584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:24.146256 13584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:24.151605 13589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:24.151563 13592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:24.151610 13590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:24.151779 13584 server_base.cc:1034] running on GCE node
I20260924 17:33:24.151988 13584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:24.152173 13584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:24.153296 13584 hybrid_clock.cc:648] HybridClock initialized: now 1790271204153279 us; error 36 us; skew 500 ppm
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:24.155792 13584 init.cc:377] Logged in from keytab as oryx/127.6.37.3@KRBTEST.COM (short username oryx)
I20260924 17:33:24.156209 13584 webserver.cc:460] Webserver started at http://127.6.37.3:39411/ using document root <none> and password file <none>
I20260924 17:33:24.156447 13584 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:24.156502 13584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:24.157804 13584 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:24.158362 13599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.158560 13584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:24.158659 13584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "9482df821b3d45e1a6e0b3617ef2cc46"
format_stamp: "Formatted at 2026-09-24 17:33:23 on dist-test-slave-gcz9"
server_key: "ab9c6ba8abdab239e28e3ebf7b8d7d73"
server_key_iv: "399df22d1b80e03662804c0eacac699f"
server_key_version: "encryptionkey@0"
I20260924 17:33:24.159039 13584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:24.166949 13584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:24.168710 13584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:24.168872 13584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:24.169093 13584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:33:24.169404 13584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:24.169459 13584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.169502 13584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:24.169543 13584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:24.175499 13584 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38763
I20260924 17:33:24.175582 13712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38763 every 8 connection(s)
I20260924 17:33:24.175922 13584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:24.183585 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 13584
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.60@KRBTEST.COM
Sep 24 17:33:24 dist-test-slave-gcz9 krb5kdc[12430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271204, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.61@KRBTEST.COM
I20260924 17:33:24.187916 13719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.176923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:58861)
0924 17:33:24.177973 (+ 1050us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.177984 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.178073 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.178250 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.178251 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.178457 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:24.178648 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.178653 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.179597 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.179598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.180699 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.180702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.181161 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.181304 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.181828 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:24.181836 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:24.183509 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:24.185927 (+ 2418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.185934 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.185936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.186269 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.186492 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.186493 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.186502 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.186651 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.187006 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:24.187013 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:24.187191 (+ 178us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.187333 (+ 142us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.187538 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"mutex_wait_us":110,"thread_start_us":56,"threads_started":1}
I20260924 17:33:24.188145 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.176684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:42271 (local address 127.6.37.60:42735)
0924 17:33:24.176730 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.176732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.177019 (+ 287us) server_negotiation.cc:407] Connection header received
0924 17:33:24.177538 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.177539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.177549 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.177634 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.178766 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.179573 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181052 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.181256 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181341 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.184999 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.185000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.185001 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.185009 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.186935 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.187367 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.187368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.187369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.187426 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.187620 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.187621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.187622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.187739 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.187778 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.187981 (+ 203us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.188060 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:33:24.188434 13718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.176641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:42735 (local address 127.6.37.3:42271)
0924 17:33:24.176894 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.176935 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.177451 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.177729 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.177732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.178431 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:24.178650 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.178656 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.179673 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.179674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.180952 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.180953 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.181340 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.181466 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.182012 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:24.182017 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:24.184881 (+ 2864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:24.187032 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.187033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.187033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.187275 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.187500 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.187500 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.187500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.187555 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.187835 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:24.187836 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:24.187876 (+ 40us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.188233 (+ 357us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.188340 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":34,"thread_start_us":88,"threads_started":1}
I20260924 17:33:24.188819 13713 heartbeater.cc:347] Connected to a master server at 127.6.37.60:42735
I20260924 17:33:24.188941 13713 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:24.189037 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.177012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:58861 (local address 127.6.37.62:42529)
0924 17:33:24.177069 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.177071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.178046 (+ 975us) server_negotiation.cc:407] Connection header received
0924 17:33:24.178149 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.178151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.178163 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.178230 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.178742 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.179389 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.180795 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.181037 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181099 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.183605 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.183607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.183607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.183615 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.185832 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.186352 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.186354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.186354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.186419 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.186727 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.186728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.186729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.186912 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.186975 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.188849 (+ 1874us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.188928 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260924 17:33:24.189146 13713 heartbeater.cc:511] Master 127.6.37.60:42735 requested a full tablet report, sending...
I20260924 17:33:24.189492 13714 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42529
I20260924 17:33:24.189566 13714 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:24.189630 13714 heartbeater.cc:511] Master 127.6.37.62:42529 requested a full tablet report, sending...
I20260924 17:33:24.189735 13260 ts_manager.cc:194] Registered new tserver with Master: 9482df821b3d45e1a6e0b3617ef2cc46 (127.6.37.3:38763)
I20260924 17:33:24.189838 12475 ts_manager.cc:194] Re-registered known tserver with Master: 9482df821b3d45e1a6e0b3617ef2cc46 (127.6.37.3:38763)
I20260924 17:33:24.190260 12475 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:58861
I20260924 17:33:24.190644 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.176633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:48377 (local address 127.6.37.61:41699)
0924 17:33:24.176730 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.176732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.177668 (+ 936us) server_negotiation.cc:407] Connection header received
0924 17:33:24.177725 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.177727 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.177739 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.177790 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.178766 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.179569 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181031 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.181310 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181375 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.186401 (+ 5026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.186402 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.186402 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.186409 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.188214 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.188602 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.188603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.188604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.188657 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.188828 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.188828 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.188828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.188950 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.189022 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.190486 (+ 1464us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.190570 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260924 17:33:24.191473 13717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.176641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:41699 (local address 127.6.37.3:48377)
0924 17:33:24.177592 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.177599 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.177666 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.177810 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.177812 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.178406 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:24.178650 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.178656 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.179674 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.179674 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.180925 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.180936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.181431 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.181432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.181561 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.182205 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:24.182210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:24.184921 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:24.188298 (+ 3377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.188299 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.188299 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.188521 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.188716 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:24.188717 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:24.188717 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:24.188767 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:24.189051 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:24.189052 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:24.189148 (+ 96us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.189218 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.189336 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":927,"mutex_wait_us":72,"thread_start_us":83,"threads_started":1}
I20260924 17:33:24.192073 13715 heartbeater.cc:347] Connected to a master server at 127.6.37.61:41699
I20260924 17:33:24.192133 13715 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:24.192209 13715 heartbeater.cc:511] Master 127.6.37.61:41699 requested a full tablet report, sending...
I20260924 17:33:24.192653 13075 ts_manager.cc:194] Registered new tserver with Master: 9482df821b3d45e1a6e0b3617ef2cc46 (127.6.37.3:38763)
I20260924 17:33:24.196337 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.185134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.6.37.62:42529)
0924 17:33:24.185621 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.185624 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.186105 (+ 481us) server_negotiation.cc:407] Connection header received
0924 17:33:24.186216 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.186217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.186230 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.186344 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.187382 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.188123 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.190210 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.190567 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.190633 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.192220 (+ 1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.192222 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.192222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.192229 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.194203 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.194639 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.194640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.194640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.194707 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.195041 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.195053 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.195054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.195215 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.195291 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.195508 (+ 217us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.196220 (+ 712us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":85,"threads_started":1}
I20260924 17:33:24.197479 13728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.185541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53876 (local address 127.6.37.60:42735)
0924 17:33:24.185786 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.185788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.185990 (+ 202us) server_negotiation.cc:407] Connection header received
0924 17:33:24.186014 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.186015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.186025 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.186075 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.189572 (+ 3497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.190294 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.191547 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.191915 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.191957 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.194215 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.194217 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.194217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.194223 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.195984 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.196434 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.196435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.196435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.196486 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.196854 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.196855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.196856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.197001 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.197087 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.197298 (+ 211us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.197372 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":52,"threads_started":1}
I20260924 17:33:24.199458 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.185054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37196 (local address 127.6.37.61:41699)
0924 17:33:24.190743 (+ 5689us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.190746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.190755 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:24.190777 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.190778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.190790 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.190842 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.192664 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.193390 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.194412 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.194645 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.194706 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.196394 (+ 1688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.196396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.196396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.196403 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.198187 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.198619 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.198620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.198621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.198673 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.198960 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.198961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.198962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.199077 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.199197 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.199279 (+ 82us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.199360 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5671,"thread_start_us":62,"threads_started":1}
I20260924 17:33:24.198060 12475 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:24.200225 12475 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:24.208338 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.203975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45869 (local address 127.0.0.1:41816)
0924 17:33:24.204032 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.204043 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.204079 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.205042 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.205043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.205045 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:24.205086 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.205088 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.206064 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.206065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.207343 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.207347 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.208106 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.208107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.208165 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.208168 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.208213 (+ 45us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.208255 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":37}
I20260924 17:33:24.208664 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.204073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41816 (local address 127.6.37.1:45869)
0924 17:33:24.204830 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.204834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.204844 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:24.204908 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.204910 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.204926 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.205044 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:24.205145 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.205958 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.207444 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.208016 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.208108 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.208474 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.208518 (+ 44us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.208558 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":184,"threads_started":1}
I20260924 17:33:24.208818 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.204360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.6.37.3:38763)
0924 17:33:24.204625 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.204630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.204668 (+ 38us) server_negotiation.cc:407] Connection header received
0924 17:33:24.204769 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.204771 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.204787 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.204859 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:24.205027 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.206055 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.207208 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.208143 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.208235 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.208313 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.208629 (+ 316us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.208673 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":131,"threads_started":1}
I20260924 17:33:24.208827 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.204007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37129 (local address 127.0.0.1:39268)
0924 17:33:24.204447 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.204455 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.204528 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.204739 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.204740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.204742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:24.204790 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.204792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.206119 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.206120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.207419 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.207421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.208374 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.208375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.208542 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.208546 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.208580 (+ 34us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.208627 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":25,"thread_start_us":83,"threads_started":1}
I20260924 17:33:24.209136 13737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.204261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38763 (local address 127.0.0.1:41786)
0924 17:33:24.204620 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.204629 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.204675 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.204920 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.204920 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.204922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:24.204954 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.204956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.206142 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.206143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.207128 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.207131 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.208354 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.208355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.208530 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.208536 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.208606 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.208635 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":20,"thread_start_us":60,"threads_started":1}
I20260924 17:33:24.209543 13736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.204099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39268 (local address 127.6.37.2:37129)
0924 17:33:24.204398 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.204403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.204520 (+ 117us) server_negotiation.cc:407] Connection header received
0924 17:33:24.204611 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.204614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.204634 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.204876 (+ 242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:24.204933 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.206033 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.207523 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.208236 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.209293 (+ 1057us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.209380 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.209409 (+ 29us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.209455 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":154,"threads_started":1}
I20260924 17:33:24.209580 13373 tablet_service.cc:1467] Processing CreateTablet for tablet 4acf8ade4a0f41da9b51a64bd8f9171e (DEFAULT_TABLE table=test-table [id=95c911443e6d48b0ae4d5c65bc0b2cbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:24.210035 13373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4acf8ade4a0f41da9b51a64bd8f9171e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:24.209911 13647 tablet_service.cc:1467] Processing CreateTablet for tablet 4acf8ade4a0f41da9b51a64bd8f9171e (DEFAULT_TABLE table=test-table [id=95c911443e6d48b0ae4d5c65bc0b2cbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:24.210358 13647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4acf8ade4a0f41da9b51a64bd8f9171e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:24.215720 13740 tablet_bootstrap.cc:492] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Bootstrap starting.
I20260924 17:33:24.215847 13511 tablet_service.cc:1467] Processing CreateTablet for tablet 4acf8ade4a0f41da9b51a64bd8f9171e (DEFAULT_TABLE table=test-table [id=95c911443e6d48b0ae4d5c65bc0b2cbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:24.216276 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4acf8ade4a0f41da9b51a64bd8f9171e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:24.216665 13740 tablet_bootstrap.cc:654] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:24.217383 13740 log.cc:824] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:24.218456 13740 tablet_bootstrap.cc:492] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: No bootstrap required, opened a new log
I20260924 17:33:24.218564 13740 ts_tablet_manager.cc:1397] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:33:24.219146 13739 tablet_bootstrap.cc:492] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Bootstrap starting.
I20260924 17:33:24.220166 13739 tablet_bootstrap.cc:654] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:24.220667 13739 log.cc:824] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:24.221626 13739 tablet_bootstrap.cc:492] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: No bootstrap required, opened a new log
I20260924 17:33:24.221693 13739 ts_tablet_manager.cc:1397] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:33:24.222028 13743 tablet_bootstrap.cc:492] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Bootstrap starting.
I20260924 17:33:24.222191 13740 raft_consensus.cc:348] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.222359 13740 raft_consensus.cc:374] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:24.222404 13740 raft_consensus.cc:729] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e988d5858a244408d25821580b7a548, State: Initialized, Role: FOLLOWER
I20260924 17:33:24.222544 13740 consensus_queue.cc:260] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.222949 13740 ts_tablet_manager.cc:1428] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Time spent starting tablet: real 0.004s user 0.000s sys 0.005s
I20260924 17:33:24.223070 13440 heartbeater.cc:503] Master 127.6.37.62:42529 was elected leader, sending a full tablet report...
I20260924 17:33:24.223753 13743 tablet_bootstrap.cc:654] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:24.224328 13743 log.cc:824] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:24.225389 13743 tablet_bootstrap.cc:492] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: No bootstrap required, opened a new log
I20260924 17:33:24.225467 13743 ts_tablet_manager.cc:1397] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260924 17:33:24.225741 13739 raft_consensus.cc:348] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.225904 13739 raft_consensus.cc:374] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:24.225942 13739 raft_consensus.cc:729] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9482df821b3d45e1a6e0b3617ef2cc46, State: Initialized, Role: FOLLOWER
I20260924 17:33:24.226065 13739 consensus_queue.cc:260] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.226498 13739 ts_tablet_manager.cc:1428] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260924 17:33:24.226599 13714 heartbeater.cc:503] Master 127.6.37.62:42529 was elected leader, sending a full tablet report...
I20260924 17:33:24.229588 13743 raft_consensus.cc:348] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.229707 13743 raft_consensus.cc:374] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:24.229728 13743 raft_consensus.cc:729] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90fbeebd5ec54841b818e8e3aea9aaee, State: Initialized, Role: FOLLOWER
I20260924 17:33:24.229854 13743 consensus_queue.cc:260] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.230109 13743 ts_tablet_manager.cc:1428] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260924 17:33:24.230232 13578 heartbeater.cc:503] Master 127.6.37.62:42529 was elected leader, sending a full tablet report...
I20260924 17:33:24.245162 13747 raft_consensus.cc:482] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:24.245255 13747 raft_consensus.cc:504] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.245551 13747 leader_election.cc:288] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e988d5858a244408d25821580b7a548 (127.6.37.1:45869), 9482df821b3d45e1a6e0b3617ef2cc46 (127.6.37.3:38763)
I20260924 17:33:24.248462 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.245706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45869 (local address 127.6.37.2:46105)
0924 17:33:24.245767 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.245780 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.245881 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.246070 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.246070 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.246072 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:24.246185 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.246186 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.246827 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.246828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.247624 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.247626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.248196 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.248197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.248312 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.248317 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.248372 (+ 55us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.248412 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260924 17:33:24.248560 13735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.245817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:46105 (local address 127.6.37.1:45869)
0924 17:33:24.245869 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.245870 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.245880 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:24.245967 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.245968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.245981 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.246051 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:24.246265 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.246737 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.247722 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.248121 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.248172 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.248180 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.248386 (+ 206us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.248459 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260924 17:33:24.248731 13583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.245706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38763 (local address 127.6.37.2:34327)
0924 17:33:24.245801 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:24.245811 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:24.245850 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:24.245996 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:24.245996 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:24.245998 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:24.246185 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.246187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.246846 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.246847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.247745 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:24.247747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.248339 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.248340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:24.248543 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.248546 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:24.248606 (+ 60us) client_negotiation.cc:240] Negotiation successful
0924 17:33:24.248650 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":47}
I20260924 17:33:24.248800 13738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.245824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:34327 (local address 127.6.37.3:38763)
0924 17:33:24.245868 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.245870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.245879 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:24.245906 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.245906 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.245919 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.245980 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:24.246264 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.246741 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.247836 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.248238 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.248334 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.248345 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.248662 (+ 317us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.248705 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:24.249042 13667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4acf8ade4a0f41da9b51a64bd8f9171e" candidate_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" is_pre_election: true
I20260924 17:33:24.249109 13393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4acf8ade4a0f41da9b51a64bd8f9171e" candidate_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e988d5858a244408d25821580b7a548" is_pre_election: true
I20260924 17:33:24.249191 13667 raft_consensus.cc:2454] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90fbeebd5ec54841b818e8e3aea9aaee in term 0.
I20260924 17:33:24.249264 13393 raft_consensus.cc:2454] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90fbeebd5ec54841b818e8e3aea9aaee in term 0.
I20260924 17:33:24.249423 13466 leader_election.cc:302] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90fbeebd5ec54841b818e8e3aea9aaee, 9482df821b3d45e1a6e0b3617ef2cc46; no voters:
I20260924 17:33:24.249598 13747 raft_consensus.cc:2781] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:24.249677 13747 raft_consensus.cc:482] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:24.249714 13747 raft_consensus.cc:3037] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:24.250651 13747 raft_consensus.cc:504] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.250797 13747 leader_election.cc:288] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [CANDIDATE]: Term 1 election: Requested vote from peers 6e988d5858a244408d25821580b7a548 (127.6.37.1:45869), 9482df821b3d45e1a6e0b3617ef2cc46 (127.6.37.3:38763)
I20260924 17:33:24.250943 13393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4acf8ade4a0f41da9b51a64bd8f9171e" candidate_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e988d5858a244408d25821580b7a548"
I20260924 17:33:24.251006 13667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4acf8ade4a0f41da9b51a64bd8f9171e" candidate_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9482df821b3d45e1a6e0b3617ef2cc46"
I20260924 17:33:24.251013 13393 raft_consensus.cc:3037] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:24.251080 13667 raft_consensus.cc:3037] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:24.252054 13667 raft_consensus.cc:2454] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90fbeebd5ec54841b818e8e3aea9aaee in term 1.
I20260924 17:33:24.252059 13393 raft_consensus.cc:2454] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90fbeebd5ec54841b818e8e3aea9aaee in term 1.
I20260924 17:33:24.252223 13467 leader_election.cc:302] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e988d5858a244408d25821580b7a548, 90fbeebd5ec54841b818e8e3aea9aaee; no voters:
I20260924 17:33:24.252324 13747 raft_consensus.cc:2781] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:24.252473 13747 raft_consensus.cc:686] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 1 LEADER]: Becoming Leader. State: Replica: 90fbeebd5ec54841b818e8e3aea9aaee, State: Running, Role: LEADER
I20260924 17:33:24.252681 13747 consensus_queue.cc:237] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } }
I20260924 17:33:24.253491 12475 catalog_manager.cc:5495] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee reported cstate change: term changed from 0 to 1, leader changed from <none> to 90fbeebd5ec54841b818e8e3aea9aaee (127.6.37.2). New cstate: current_term: 1 leader_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90fbeebd5ec54841b818e8e3aea9aaee" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:24.268914 13736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.266531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39272 (local address 127.6.37.2:37129)
0924 17:33:24.266593 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.266595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.266614 (+ 19us) server_negotiation.cc:407] Connection header received
0924 17:33:24.266646 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.266647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.266664 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.266728 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:24.266852 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.267417 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.268149 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.268388 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.268448 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.268588 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:24.268687 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:24.268751 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.268784 (+ 33us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.268804 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:33:24.270787 13393 raft_consensus.cc:1261] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 1 FOLLOWER]: Refusing update from remote peer 90fbeebd5ec54841b818e8e3aea9aaee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:24.271119 13667 raft_consensus.cc:1261] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 1 FOLLOWER]: Refusing update from remote peer 90fbeebd5ec54841b818e8e3aea9aaee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:24.271548 13748 consensus_queue.cc:1035] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e988d5858a244408d25821580b7a548" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:24.271687 13747 consensus_queue.cc:1035] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [LEADER]: Connected to new peer: Peer: permanent_uuid: "9482df821b3d45e1a6e0b3617ef2cc46" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:24.275807 13751 mvcc.cc:205] Tried to move back new op lower bound from 7332950852690534400 to 7332950852619755520. Current Snapshot: MvccSnapshot[applied={T|T < 7332950852690534400 or (T in {7332950852690534400})}]
I20260924 17:33:24.276109 13753 mvcc.cc:205] Tried to move back new op lower bound from 7332950852690534400 to 7332950852619755520. Current Snapshot: MvccSnapshot[applied={T|T < 7332950852690534400}]
I20260924 17:33:24.277196 12474 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:24.277304 12474 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:24.278720 12474 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c037a5d7cb484408a9e95ce76dc4ae63: Sending DeleteTablet for 3 replicas of tablet 4acf8ade4a0f41da9b51a64bd8f9171e
I20260924 17:33:24.279156 13647 tablet_service.cc:1514] Processing DeleteTablet for tablet 4acf8ade4a0f41da9b51a64bd8f9171e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:24 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:41786
I20260924 17:33:24.279408 13760 tablet_replica.cc:330] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: stopping tablet replica
I20260924 17:33:24.279574 13373 tablet_service.cc:1514] Processing DeleteTablet for tablet 4acf8ade4a0f41da9b51a64bd8f9171e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:24 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:41816
I20260924 17:33:24.279732 13760 raft_consensus.cc:2229] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:24.279896 13760 raft_consensus.cc:2258] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:24.280005 13511 tablet_service.cc:1514] Processing DeleteTablet for tablet 4acf8ade4a0f41da9b51a64bd8f9171e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:24 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:39268
I20260924 17:33:24.280310 13763 tablet_replica.cc:330] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: stopping tablet replica
I20260924 17:33:24.280354 13760 ts_tablet_manager.cc:1905] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:24.280488 13763 raft_consensus.cc:2229] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:24.280803 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12443
I20260924 17:33:24.280821 13762 tablet_replica.cc:330] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: stopping tablet replica
I20260924 17:33:24.281250 13762 raft_consensus.cc:2229] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:24.281395 13762 raft_consensus.cc:2258] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:24.281879 13762 ts_tablet_manager.cc:1905] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:24.283653 13760 ts_tablet_manager.cc:1918] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:24.283718 13760 log.cc:1196] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/4acf8ade4a0f41da9b51a64bd8f9171e
I20260924 17:33:24.283986 13760 ts_tablet_manager.cc:1939] T 4acf8ade4a0f41da9b51a64bd8f9171e P 9482df821b3d45e1a6e0b3617ef2cc46: Deleting consensus metadata
I20260924 17:33:24.284471 13762 ts_tablet_manager.cc:1918] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:24.284552 13762 log.cc:1196] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/4acf8ade4a0f41da9b51a64bd8f9171e
I20260924 17:33:24.284857 13762 ts_tablet_manager.cc:1939] T 4acf8ade4a0f41da9b51a64bd8f9171e P 6e988d5858a244408d25821580b7a548: Deleting consensus metadata
I20260924 17:33:24.280627 13763 raft_consensus.cc:2258] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:24.288228 13763 ts_tablet_manager.cc:1905] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260924 17:33:24.289651 13600 connection.cc:535] server connection from 127.0.0.1:41786 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260924 17:33:24.290019 13326 connection.cc:535] server connection from 127.0.0.1:41816 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260924 17:33:24.290431 13763 ts_tablet_manager.cc:1918] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:24.290584 13763 log.cc:1196] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/4acf8ade4a0f41da9b51a64bd8f9171e
I20260924 17:33:24.290987 13763 ts_tablet_manager.cc:1939] T 4acf8ade4a0f41da9b51a64bd8f9171e P 90fbeebd5ec54841b818e8e3aea9aaee: Deleting consensus metadata
W20260924 17:33:24.291378 13467 connection.cc:441] server connection from 127.0.0.1:39268 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39268 (request call id 1) could send its response
I20260924 17:33:24.292687 13728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.279471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53888 (local address 127.6.37.60:42735)
0924 17:33:24.279540 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.279542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.283564 (+ 4022us) server_negotiation.cc:407] Connection header received
0924 17:33:24.284236 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.284237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.284253 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.284284 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.285568 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.286364 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.287468 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.287978 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.288038 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.289698 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.289699 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.289699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.289706 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.291433 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.291833 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.291834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.291835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.291887 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.292106 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.292107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.292108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.292233 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.292308 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.292515 (+ 207us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.292598 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260924 17:33:24.300408 13114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.292248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37208 (local address 127.6.37.61:41699)
0924 17:33:24.292295 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.292310 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.292528 (+ 218us) server_negotiation.cc:407] Connection header received
0924 17:33:24.292642 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.292643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.292655 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.292692 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.293551 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.294156 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.295151 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.295618 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.295671 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.297357 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.297358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.297359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.297367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.299173 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.299537 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.299538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.299539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.299593 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.299815 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.299816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.299816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.299950 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.300032 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.300231 (+ 199us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.300310 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260924 17:33:24.300547 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:24.292402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53900 (local address 127.6.37.60:42735)
0924 17:33:24.292444 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:24.292446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:24.292552 (+ 106us) server_negotiation.cc:407] Connection header received
0924 17:33:24.292657 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:24.292658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:24.292669 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:24.292701 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:24.293740 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.294481 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.295769 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:24.296338 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:24.296406 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:24.297775 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:24.297776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:24.297777 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:24.297783 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:24.299312 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.299720 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.299721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.299722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.299769 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:24.299990 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:24.299991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:24.299991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:24.300099 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:24.300225 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:24.300365 (+ 140us) server_negotiation.cc:299] Negotiation successful
0924 17:33:24.300436 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:25.277361 13771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:25.277052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:41311)
0924 17:33:25.277199 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:25.277284 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":64,"threads_started":1}
I20260924 17:33:25.277627 13772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:25.277161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:39513)
0924 17:33:25.277395 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:25.277568 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":190,"threads_started":1}
W20260924 17:33:25.277643 13578 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:42529 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
W20260924 17:33:25.277936 13714 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:42529 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:25.277966 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:25.277682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:38859)
0924 17:33:25.277824 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:25.277893 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
W20260924 17:33:25.278218 13440 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:42529 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:25.779614 13774 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c037a5d7cb484408a9e95ce76dc4ae63)
I20260924 17:33:25.779812 13774 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:25.780081 13774 leader_election.cc:288] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529)
I20260924 17:33:25.780454 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:25.780256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:59328)
0924 17:33:25.780357 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:25.780416 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":55,"threads_started":1}
W20260924 17:33:25.780606 13061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:25.781044 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:25.780929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:59338)
0924 17:33:25.780983 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:25.781019 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:33:25.781134 13061 leader_election.cc:334] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529): Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:25.781198 13061 leader_election.cc:302] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c99553586a74095a79d682dbb31cd3a; no voters: c037a5d7cb484408a9e95ce76dc4ae63
I20260924 17:33:25.781287 13774 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:33:26.278234 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:26.277941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:33899)
0924 17:33:26.278117 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:26.278170 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":71,"threads_started":1}
I20260924 17:33:26.278502 13778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:26.278238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:43365)
0924 17:33:26.278405 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:26.278455 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":64,"threads_started":1}
I20260924 17:33:26.278852 13779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:26.278637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:35335)
0924 17:33:26.278775 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:26.278810 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":60,"threads_started":1}
I20260924 17:33:27.279095 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:27.278832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:59509)
0924 17:33:27.278989 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:27.279034 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":85,"threads_started":1}
I20260924 17:33:27.279137 13781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:27.278908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:39707)
0924 17:33:27.279037 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:27.279077 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":52,"threads_started":1}
I20260924 17:33:27.279635 13782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:27.279408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:57433)
0924 17:33:27.279537 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:27.279584 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":58,"threads_started":1}
I20260924 17:33:27.427069 13783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c037a5d7cb484408a9e95ce76dc4ae63)
I20260924 17:33:27.427178 13783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:27.427367 13783 leader_election.cc:288] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529)
I20260924 17:33:27.427719 13784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:27.427531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:53958)
0924 17:33:27.427634 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:27.427679 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":48,"threads_started":1}
I20260924 17:33:27.428159 13784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:27.428063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:53966)
0924 17:33:27.428112 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:27.428139 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260924 17:33:27.428244 13061 leader_election.cc:334] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529): Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:27.428289 13061 leader_election.cc:302] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c99553586a74095a79d682dbb31cd3a; no voters: c037a5d7cb484408a9e95ce76dc4ae63
I20260924 17:33:27.428354 13783 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:33:28.279942 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:28.279711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:37119)
0924 17:33:28.279835 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:28.279880 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":58,"threads_started":1}
I20260924 17:33:28.280179 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:28.280012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:38205)
0924 17:33:28.280103 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:28.280134 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75,"thread_start_us":46,"threads_started":1}
I20260924 17:33:28.280179 13786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:28.279689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:42351)
0924 17:33:28.279850 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:28.280143 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":60,"threads_started":1}
I20260924 17:33:29.280764 13789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:29.280404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:51577)
0924 17:33:29.280678 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:29.280724 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":73,"threads_started":1}
I20260924 17:33:29.280755 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:29.280541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:43641)
0924 17:33:29.280651 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:29.280693 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":55,"threads_started":1}
I20260924 17:33:29.280901 13791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:29.280632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:53787)
0924 17:33:29.280732 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:29.280758 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":52,"threads_started":1}
I20260924 17:33:29.977224 13792 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c037a5d7cb484408a9e95ce76dc4ae63)
I20260924 17:33:29.977334 13792 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:29.977561 13792 leader_election.cc:288] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529)
I20260924 17:33:29.977999 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:29.977769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:54212)
0924 17:33:29.977916 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:29.977951 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":95,"threads_started":1}
I20260924 17:33:29.978489 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:29.978364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:54214)
0924 17:33:29.978408 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:29.978462 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260924 17:33:29.978586 13061 leader_election.cc:334] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529): Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:29.978667 13061 leader_election.cc:302] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c99553586a74095a79d682dbb31cd3a; no voters: c037a5d7cb484408a9e95ce76dc4ae63
I20260924 17:33:29.978772 13792 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:33:30.281464 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:30.281191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:34411)
0924 17:33:30.281348 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:30.281396 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":73,"threads_started":1}
I20260924 17:33:30.281479 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:30.281254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:57829)
0924 17:33:30.281388 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:30.281428 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260924 17:33:30.281520 13797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:30.281332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:34455)
0924 17:33:30.281446 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:30.281477 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260924 17:33:31.282090 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:31.281846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:50729)
0924 17:33:31.281987 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:31.282030 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260924 17:33:31.282090 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:31.281894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:54933)
0924 17:33:31.282010 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:31.282043 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260924 17:33:31.282090 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:31.281894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:38893)
0924 17:33:31.282014 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:31.282043 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260924 17:33:32.282727 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:32.282501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:47431)
0924 17:33:32.282638 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:32.282679 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260924 17:33:32.282779 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:32.282501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:37085)
0924 17:33:32.282682 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:32.282725 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
I20260924 17:33:32.282938 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:32.282684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:33529)
0924 17:33:32.282837 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:32.282894 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":46,"threads_started":1}
I20260924 17:33:33.283419 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:33.283190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:58169)
0924 17:33:33.283353 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:33.283382 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":64,"threads_started":1}
I20260924 17:33:33.283411 13804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:33.283188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:38743)
0924 17:33:33.283310 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:33.283354 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260924 17:33:33.283547 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:33.283350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:57249)
0924 17:33:33.283450 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:33.283486 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":58,"threads_started":1}
I20260924 17:33:34.284150 13808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:34.283901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:33875)
0924 17:33:34.284048 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:34.284090 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260924 17:33:34.284150 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:34.283889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:49891)
0924 17:33:34.284044 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:34.284090 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":62,"threads_started":1}
I20260924 17:33:34.284252 13809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:34.284032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:42315)
0924 17:33:34.284158 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:34.284211 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":44,"threads_started":1}
I20260924 17:33:34.941144 13810 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c037a5d7cb484408a9e95ce76dc4ae63)
I20260924 17:33:34.941272 13810 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:34.941464 13810 leader_election.cc:288] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529)
I20260924 17:33:34.941891 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:34.941659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:54572)
0924 17:33:34.941816 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:34.941851 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
W20260924 17:33:34.941977 13061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260924 17:33:34.942334 13811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:34.942242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:54580)
0924 17:33:34.942288 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:34.942315 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:33:34.942425 13061 leader_election.cc:334] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529): Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:34.942478 13061 leader_election.cc:302] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c99553586a74095a79d682dbb31cd3a; no voters: c037a5d7cb484408a9e95ce76dc4ae63
I20260924 17:33:34.942567 13810 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:33:35.284785 13814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:35.284540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:59597)
0924 17:33:35.284719 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:35.284748 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260924 17:33:35.284773 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:35.284537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:42195)
0924 17:33:35.284674 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:35.284713 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
I20260924 17:33:35.284771 13815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:35.284577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:37405)
0924 17:33:35.284678 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:35.284717 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":46,"threads_started":1}
I20260924 17:33:36.285462 13816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:36.285188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:41397)
0924 17:33:36.285340 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:36.285390 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":73,"threads_started":1}
I20260924 17:33:36.285470 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:36.285231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:56987)
0924 17:33:36.285375 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:36.285414 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
I20260924 17:33:36.285534 13818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:36.285332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:60631)
0924 17:33:36.285464 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:36.285494 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":45,"threads_started":1}
I20260924 17:33:37.286095 13820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:37.285867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:33437)
0924 17:33:37.286000 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:37.286041 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260924 17:33:37.286095 13819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:37.285867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:35289)
0924 17:33:37.285999 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:37.286040 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
I20260924 17:33:37.286120 13821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:37.285949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:52477)
0924 17:33:37.286049 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:37.286079 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":56,"threads_started":1}
I20260924 17:33:38.286742 13822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:38.286507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:58619)
0924 17:33:38.286664 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:38.286697 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260924 17:33:38.286837 13823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:38.286577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:55979)
0924 17:33:38.286727 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:38.286766 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260924 17:33:38.286931 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:38.286679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:53155)
0924 17:33:38.286824 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:38.286858 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":50,"threads_started":1}
I20260924 17:33:38.857561 13825 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c037a5d7cb484408a9e95ce76dc4ae63)
I20260924 17:33:38.857661 13825 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:38.857897 13825 leader_election.cc:288] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529)
I20260924 17:33:38.858251 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:38.858065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:32880)
0924 17:33:38.858168 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:38.858211 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":58,"threads_started":1}
I20260924 17:33:38.858655 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:38.858562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:32896)
0924 17:33:38.858610 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:38.858636 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260924 17:33:38.858762 13061 leader_election.cc:334] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529): Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:38.858865 13061 leader_election.cc:302] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c99553586a74095a79d682dbb31cd3a; no voters: c037a5d7cb484408a9e95ce76dc4ae63
I20260924 17:33:38.858991 13825 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:33:39.287582 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:39.287343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:34425)
0924 17:33:39.287475 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:39.287519 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260924 17:33:39.287600 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:39.287403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:39569)
0924 17:33:39.287522 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:39.287555 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":56,"threads_started":1}
I20260924 17:33:39.287600 13829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:39.287410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:42387)
0924 17:33:39.287522 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:39.287555 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":52,"threads_started":1}
I20260924 17:33:40.288256 13831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:40.287992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:36385)
0924 17:33:40.288144 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:40.288188 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260924 17:33:40.288332 13833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:40.288102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:35137)
0924 17:33:40.288262 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:40.288291 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":59,"threads_started":1}
I20260924 17:33:40.288328 13832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:40.288002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:37249)
0924 17:33:40.288203 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:40.288249 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":66,"threads_started":1}
I20260924 17:33:41.288892 13835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:41.288638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:57417)
0924 17:33:41.288788 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:41.288832 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":69,"threads_started":1}
I20260924 17:33:41.288908 13836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:41.288665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:34125)
0924 17:33:41.288815 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:41.288864 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":61,"threads_started":1}
I20260924 17:33:41.289116 13834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:41.288638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:47839)
0924 17:33:41.289043 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:41.289078 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":65,"threads_started":1}
I20260924 17:33:41.801120 13837 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c037a5d7cb484408a9e95ce76dc4ae63)
I20260924 17:33:41.801229 13837 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c037a5d7cb484408a9e95ce76dc4ae63" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42529 } } peers { permanent_uuid: "1c99553586a74095a79d682dbb31cd3a" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 41699 } attrs { promote: false } } peers { permanent_uuid: "d2fcd0e434c54ab696a4c2af7bce2d4b" member_type: NON_VOTER last_known_addr { host: "127.6.37.60" port: 42735 } attrs { promote: true } }
I20260924 17:33:41.801400 13837 leader_election.cc:288] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529)
I20260924 17:33:41.801736 13838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:41.801561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:33050)
0924 17:33:41.801656 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:41.801699 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":45,"threads_started":1}
W20260924 17:33:41.801826 13061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260924 17:33:41.802220 13838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:41.802114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.0.0.1:33066)
0924 17:33:41.802168 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:41.802195 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260924 17:33:41.802292 13061 leader_election.cc:334] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c037a5d7cb484408a9e95ce76dc4ae63 (127.6.37.62:42529): Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
I20260924 17:33:41.802336 13061 leader_election.cc:302] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 1c99553586a74095a79d682dbb31cd3a; no voters: c037a5d7cb484408a9e95ce76dc4ae63
I20260924 17:33:41.802408 13837 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1c99553586a74095a79d682dbb31cd3a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:33:42.289563 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:42.289343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:44753)
0924 17:33:42.289446 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:42.289486 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":54,"threads_started":1}
I20260924 17:33:42.289580 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:42.289328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:33045)
0924 17:33:42.289465 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:42.289506 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260924 17:33:42.289738 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:42.289460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:49821)
0924 17:33:42.289612 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:42.289690 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260924 17:33:43.290263 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:43.290005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:36865)
0924 17:33:43.290163 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:43.290214 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":68,"threads_started":1}
I20260924 17:33:43.290294 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:43.290028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:33473)
0924 17:33:43.290198 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:43.290240 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":108,"threads_started":1}
I20260924 17:33:43.290429 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:43.290199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:54831)
0924 17:33:43.290311 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:43.290341 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260924 17:33:44.291117 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:44.290828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:41977)
0924 17:33:44.290980 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:44.291039 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":73,"threads_started":1}
I20260924 17:33:44.291142 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:44.290780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:37721)
0924 17:33:44.291046 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:44.291091 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
I20260924 17:33:44.291297 13848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:44.290806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:59271)
0924 17:33:44.291155 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:44.291192 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":296,"threads_started":1}
I20260924 17:33:45.291724 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:45.291501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:33121)
0924 17:33:45.291622 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:45.291664 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
I20260924 17:33:45.291731 13850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:45.291520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:43423)
0924 17:33:45.291646 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:45.291681 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260924 17:33:45.291927 13851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:45.291691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:38185)
0924 17:33:45.291855 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:45.291889 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260924 17:33:46.292352 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:46.292115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:57479)
0924 17:33:46.292234 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:46.292279 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260924 17:33:46.292516 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:46.292174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:41267)
0924 17:33:46.292433 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:46.292465 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":41,"threads_started":1}
I20260924 17:33:46.292512 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:46.292307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:39951)
0924 17:33:46.292430 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:46.292465 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":66,"threads_started":1}
I20260924 17:33:47.293129 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:47.292873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:58473)
0924 17:33:47.293032 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:47.293083 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":84,"threads_started":1}
I20260924 17:33:47.293174 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:47.292945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:51907)
0924 17:33:47.293084 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:47.293126 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260924 17:33:47.293174 13857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:47.292994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:35167)
0924 17:33:47.293112 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:47.293138 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":68,"threads_started":1}
I20260924 17:33:48.293804 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:48.293561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:46747)
0924 17:33:48.293706 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:48.293748 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
I20260924 17:33:48.293812 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:48.293574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:41669)
0924 17:33:48.293706 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:48.293760 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":58,"threads_started":1}
I20260924 17:33:48.293861 13860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:48.293666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:46271)
0924 17:33:48.293787 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:48.293821 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260924 17:33:49.294531 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:49.294259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:51303)
0924 17:33:49.294446 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:49.294483 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":103,"threads_started":1}
I20260924 17:33:49.294538 13862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:49.294276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:43439)
0924 17:33:49.294464 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:49.294495 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":109,"threads_started":1}
I20260924 17:33:49.294538 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:49.294284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:39837)
0924 17:33:49.294453 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:49.294491 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":107,"threads_started":1}
I20260924 17:33:50.295260 13864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:50.295005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:60591)
0924 17:33:50.295154 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:50.295212 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":73,"threads_started":1}
I20260924 17:33:50.295351 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:50.295040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:59809)
0924 17:33:50.295238 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:50.295295 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":45,"threads_started":1}
I20260924 17:33:50.295423 13866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:50.295077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:45641)
0924 17:33:50.295284 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:50.295320 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":62,"threads_started":1}
I20260924 17:33:51.296023 13868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:51.295794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:57499)
0924 17:33:51.295918 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:51.295958 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":55,"threads_started":1}
I20260924 17:33:51.296033 13869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:51.295794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:58057)
0924 17:33:51.295920 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:51.295956 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":62,"threads_started":1}
I20260924 17:33:51.296430 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:51.295795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:41159)
0924 17:33:51.296345 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:51.296384 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":53,"threads_started":1}
I20260924 17:33:52.296661 13870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:52.296428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:60271)
0924 17:33:52.296576 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:52.296618 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260924 17:33:52.296829 13871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:52.296578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:44281)
0924 17:33:52.296712 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:52.296764 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260924 17:33:52.297022 13872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:52.296802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:43103)
0924 17:33:52.296925 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:52.296955 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":54,"threads_started":1}
I20260924 17:33:53.297370 13873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:53.297128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:32967)
0924 17:33:53.297260 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:53.297304 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":57,"threads_started":1}
I20260924 17:33:53.297544 13874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:53.297294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:35961)
0924 17:33:53.297433 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:53.297475 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260924 17:33:53.297693 13875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:53.297448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:47487)
0924 17:33:53.297617 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:53.297649 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":51,"threads_started":1}
I20260924 17:33:54.298146 13876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:54.297918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.1:42659)
0924 17:33:54.298054 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:54.298098 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":67,"threads_started":1}
I20260924 17:33:54.298270 13877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:54.297996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.3:34013)
0924 17:33:54.298201 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:54.298228 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":80,"threads_started":1}
I20260924 17:33:54.298322 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:54.298102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42529 (local address 127.6.37.2:54819)
0924 17:33:54.298190 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:54.298226 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:42529: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70,"thread_start_us":44,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.6.37.62:42529,127.6.37.61:41699,127.6.37.60:42735, num_attempts: 1)
I20260924 17:33:54.493813 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 13222
I20260924 17:33:54.499321 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 13447
I20260924 17:33:54.504832 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 13584
I20260924 17:33:54.509491 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 12941
I20260924 17:33:54.514415 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 13129
2026-09-24T17:33:54Z chronyd exiting
I20260924 17:33:54.530620 6292 test_util.cc:175] -----------------------------------------------
I20260924 17:33:54.530671 6292 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790271173812085-6292-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (33066 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:54 dist-test-slave-gcz9 krb5kdc[13881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:54 dist-test-slave-gcz9 krb5kdc[13881](info): set up 2 sockets
Sep 24 17:33:54 dist-test-slave-gcz9 krb5kdc[13881](info): commencing operation
krb5kdc: starting...
W20260924 17:33:55.565150 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:55 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:55Z Disabled control of system clock
WARNING: no policy specified for oryx/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab.
Entry for principal oryx/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab.
I20260924 17:33:55.681962 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:36685
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab
--principal=oryx/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:36685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:55.769408 13894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:55.769629 13894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:55.769652 13894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:55.770819 13894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:55.770860 13894 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260924 17:33:55.770908 13894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:55.770921 13894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:55.770933 13894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:55.770946 13894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:55.772477 13894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:36685
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.62.keytab
--principal=oryx/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:36685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:55.772727 13894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:55.772958 13894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:55.778019 13902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:55.778052 13900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:55.778090 13894 server_base.cc:1034] running on GCE node
W20260924 17:33:55.778052 13899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:55.778533 13894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:55.778782 13894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:55.779924 13894 hybrid_clock.cc:648] HybridClock initialized: now 1790271235779897 us; error 41 us; skew 500 ppm
Sep 24 17:33:55 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271235, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:55.782577 13894 init.cc:377] Logged in from keytab as oryx/127.6.37.62@KRBTEST.COM (short username oryx)
I20260924 17:33:55.783067 13894 webserver.cc:460] Webserver started at http://127.6.37.62:40337/ using document root <none> and password file <none>
I20260924 17:33:55.783288 13894 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:55.783331 13894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:55.783471 13894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:55.784536 13894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "32b4a3357b4546a8a4368569a360669c"
format_stamp: "Formatted at 2026-09-24 17:33:55 on dist-test-slave-gcz9"
server_key: "3548faa52f8f8d07eb8bd8e5d78baeec"
server_key_iv: "eb4af8476588bbcd457d99d9871b58c8"
server_key_version: "encryptionkey@0"
I20260924 17:33:55.784938 13894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "32b4a3357b4546a8a4368569a360669c"
format_stamp: "Formatted at 2026-09-24 17:33:55 on dist-test-slave-gcz9"
server_key: "3548faa52f8f8d07eb8bd8e5d78baeec"
server_key_iv: "eb4af8476588bbcd457d99d9871b58c8"
server_key_version: "encryptionkey@0"
I20260924 17:33:55.786270 13894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:33:55.787046 13909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:55.787253 13894 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:55.787350 13894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "32b4a3357b4546a8a4368569a360669c"
format_stamp: "Formatted at 2026-09-24 17:33:55 on dist-test-slave-gcz9"
server_key: "3548faa52f8f8d07eb8bd8e5d78baeec"
server_key_iv: "eb4af8476588bbcd457d99d9871b58c8"
server_key_version: "encryptionkey@0"
I20260924 17:33:55.787421 13894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:55.807291 13894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:55.809614 13894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:55.809772 13894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:55.814769 13894 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:36685
I20260924 17:33:55.814823 13971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:36685 every 8 connection(s)
I20260924 17:33:55.815196 13894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:33:55.815918 13972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:55.816515 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 13894
I20260924 17:33:55.816599 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:33:55.816819 6292 external_mini_cluster.cc:1428] Setting key 1f62d08f05a5a72dc1a1f2cffda184c6
I20260924 17:33:55.819267 13972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Bootstrap starting.
I20260924 17:33:55.820050 13972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:55.820375 13972 log.cc:824] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:55.821100 13972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: No bootstrap required, opened a new log
I20260924 17:33:55.823048 13972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b4a3357b4546a8a4368569a360669c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36685 } }
I20260924 17:33:55.823179 13972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:55.823202 13972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b4a3357b4546a8a4368569a360669c, State: Initialized, Role: FOLLOWER
I20260924 17:33:55.823333 13972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b4a3357b4546a8a4368569a360669c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36685 } }
I20260924 17:33:55.823410 13972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:33:55.823433 13972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:33:55.823494 13972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:55.824008 13972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b4a3357b4546a8a4368569a360669c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36685 } }
I20260924 17:33:55.824133 13972 leader_election.cc:302] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32b4a3357b4546a8a4368569a360669c; no voters:
I20260924 17:33:55.824307 13972 leader_election.cc:288] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:33:55.824378 13977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 1 FOLLOWER]: Leader election won for term 1
Sep 24 17:33:55 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271235, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:55.824529 13977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [term 1 LEADER]: Becoming Leader. State: Replica: 32b4a3357b4546a8a4368569a360669c, State: Running, Role: LEADER
I20260924 17:33:55.824570 13972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:33:55.824669 13977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b4a3357b4546a8a4368569a360669c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36685 } }
I20260924 17:33:55.825202 13977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32b4a3357b4546a8a4368569a360669c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b4a3357b4546a8a4368569a360669c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36685 } } }
I20260924 17:33:55.825331 13977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:55.825560 13977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32b4a3357b4546a8a4368569a360669c. Latest consensus state: current_term: 1 leader_uuid: "32b4a3357b4546a8a4368569a360669c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32b4a3357b4546a8a4368569a360669c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 36685 } } }
I20260924 17:33:55.825630 13977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c [sys.catalog]: This master's current role is: LEADER
I20260924 17:33:55.825745 13986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:33:55.826351 13986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:33:55.828287 13986 catalog_manager.cc:1347] Generated new cluster ID: bc354065a4f34ed0ba7f75105a83db82
I20260924 17:33:55.828358 13986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:33:55.829854 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:55.817473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49018 (local address 127.6.37.62:36685)
0924 17:33:55.817680 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:55.817691 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:55.817728 (+ 37us) server_negotiation.cc:407] Connection header received
0924 17:33:55.818285 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:55.818294 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:55.818359 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:55.818523 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:55.819228 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:55.820684 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:55.821553 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:55.821984 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:55.822124 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:55.825084 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:55.825088 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:55.825089 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:55.825103 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:55.828188 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:55.828589 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:55.828592 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:55.828592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:55.828699 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:55.828921 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:55.828922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:55.828922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:55.829197 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:55.829336 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:55.829483 (+ 147us) server_negotiation.cc:299] Negotiation successful
0924 17:33:55.829624 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
I20260924 17:33:55.840915 13986 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:33:55.841617 13986 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:33:55.851711 13986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Generated new TSK 0
I20260924 17:33:55.851922 13986 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab.
Entry for principal oryx/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab.
I20260924 17:33:55.886312 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36685
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:55.968088 13998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:55.968324 13998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:55.968364 13998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:55.969513 13998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:55.969602 13998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:55.969638 13998 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:33:55.969676 13998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:33:55.971220 13998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:36685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:55.971486 13998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:55.971711 13998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:55.976732 14003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:55.976827 14004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:55.976780 14006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:55.977038 13998 server_base.cc:1034] running on GCE node
I20260924 17:33:55.977257 13998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:55.977533 13998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:55.978694 13998 hybrid_clock.cc:648] HybridClock initialized: now 1790271235978675 us; error 29 us; skew 500 ppm
Sep 24 17:33:55 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271235, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:55.981163 13998 init.cc:377] Logged in from keytab as oryx/127.6.37.1@KRBTEST.COM (short username oryx)
I20260924 17:33:55.981573 13998 webserver.cc:460] Webserver started at http://127.6.37.1:44545/ using document root <none> and password file <none>
I20260924 17:33:55.981812 13998 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:55.981879 13998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:55.982035 13998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:55.983191 13998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "5644065e044b435b92b36e8d5ace80e2"
format_stamp: "Formatted at 2026-09-24 17:33:55 on dist-test-slave-gcz9"
server_key: "5707ede97c2ab35962c809d13bd288ae"
server_key_iv: "465a57e611506a37cec8b6829b3f4836"
server_key_version: "encryptionkey@0"
I20260924 17:33:55.983553 13998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "5644065e044b435b92b36e8d5ace80e2"
format_stamp: "Formatted at 2026-09-24 17:33:55 on dist-test-slave-gcz9"
server_key: "5707ede97c2ab35962c809d13bd288ae"
server_key_iv: "465a57e611506a37cec8b6829b3f4836"
server_key_version: "encryptionkey@0"
I20260924 17:33:55.984881 13998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:33:55.985597 14013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:55.985780 13998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:55.985868 13998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "5644065e044b435b92b36e8d5ace80e2"
format_stamp: "Formatted at 2026-09-24 17:33:55 on dist-test-slave-gcz9"
server_key: "5707ede97c2ab35962c809d13bd288ae"
server_key_iv: "465a57e611506a37cec8b6829b3f4836"
server_key_version: "encryptionkey@0"
I20260924 17:33:55.985947 13998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:56.004963 13998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:56.007118 13998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:56.007283 13998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:56.007822 13998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:56.007887 13998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.007934 13998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:56.007959 13998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.014981 13998 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:33741
I20260924 17:33:56.015044 14129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:33741 every 8 connection(s)
I20260924 17:33:56.015386 13998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271235, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:56.018751 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.008426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:55987 (local address 127.6.37.62:36685)
0924 17:33:56.008486 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.008488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.008715 (+ 227us) server_negotiation.cc:407] Connection header received
0924 17:33:56.009317 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.009318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.009331 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.009395 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.010254 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.011112 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.012811 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.013101 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.013157 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.015964 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.015965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.015966 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.015972 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.017514 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.017858 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.017858 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.017859 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.017907 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.018160 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.018161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.018161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.018310 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.018405 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.018604 (+ 199us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.018682 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260924 17:33:56.018931 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.008407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.6.37.1:55987)
0924 17:33:56.008595 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.008631 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.009188 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.009468 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.009472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.009877 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.010167 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.010173 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.011219 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.011220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.012712 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.012716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.013201 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.013203 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.013372 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.013981 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.013994 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.015877 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.017583 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.017587 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.017589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.017793 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.017963 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.017963 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.017964 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.018066 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.018390 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.018395 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.018505 (+ 110us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.018586 (+ 81us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.018700 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
I20260924 17:33:56.019505 14130 heartbeater.cc:347] Connected to a master server at 127.6.37.62:36685
I20260924 17:33:56.019608 14130 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:56.019793 14130 heartbeater.cc:511] Master 127.6.37.62:36685 requested a full tablet report, sending...
I20260924 17:33:56.020372 13926 ts_manager.cc:194] Registered new tserver with Master: 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741)
I20260924 17:33:56.021176 13926 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:55987
I20260924 17:33:56.021507 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 13998
I20260924 17:33:56.021626 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:33:56.021864 6292 external_mini_cluster.cc:1428] Setting key 7d2dc7c35600997348e223fb11f8a284
I20260924 17:33:56.026966 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.020787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47055 (local address 127.6.37.62:36685)
0924 17:33:56.020827 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.020828 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.020924 (+ 96us) server_negotiation.cc:407] Connection header received
0924 17:33:56.020964 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.020965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.020974 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.021043 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.021384 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.022005 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.022921 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.023114 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.023168 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.024195 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.024197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.024197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.024204 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.025814 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.026169 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.026170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.026171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.026229 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.026442 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.026443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.026443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.026552 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.026622 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.026789 (+ 167us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.026858 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:56.026985 14137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.020721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.6.37.1:47055)
0924 17:33:56.020846 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.020856 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.020920 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.021048 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.021049 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.021221 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.021312 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.021314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.022115 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.022116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.022803 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.022807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.023192 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.023193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.023277 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.023674 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.023680 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.024102 (+ 422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.025905 (+ 1803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.025906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.025906 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.026081 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.026306 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.026307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.026307 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.026369 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.026628 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.026629 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.026671 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.026751 (+ 80us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.026857 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for oryx/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab.
Entry for principal oryx/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab.
I20260924 17:33:56.050132 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36685
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:56.132186 14140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:56.132386 14140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:56.132411 14140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:56.133466 14140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:56.133499 14140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:56.133518 14140 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:33:56.133536 14140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:33:56.135062 14140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:36685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:56.135239 14140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:56.135416 14140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:56.140231 14148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:56.140308 14140 server_base.cc:1034] running on GCE node
W20260924 17:33:56.140196 14146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:56.140200 14145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:56.140712 14140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:56.140960 14140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:56.142128 14140 hybrid_clock.cc:648] HybridClock initialized: now 1790271236142129 us; error 39 us; skew 500 ppm
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271236, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:56.144599 14140 init.cc:377] Logged in from keytab as oryx/127.6.37.2@KRBTEST.COM (short username oryx)
I20260924 17:33:56.145016 14140 webserver.cc:460] Webserver started at http://127.6.37.2:33773/ using document root <none> and password file <none>
I20260924 17:33:56.145237 14140 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:56.145306 14140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:56.145457 14140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:56.146571 14140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "840528a7b6944faeb3dc882867c05892"
format_stamp: "Formatted at 2026-09-24 17:33:56 on dist-test-slave-gcz9"
server_key: "d4335a2fe5b29b22cd921b302e5e8957"
server_key_iv: "7cc92664476c935fceb27f842820db20"
server_key_version: "encryptionkey@0"
I20260924 17:33:56.147006 14140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "840528a7b6944faeb3dc882867c05892"
format_stamp: "Formatted at 2026-09-24 17:33:56 on dist-test-slave-gcz9"
server_key: "d4335a2fe5b29b22cd921b302e5e8957"
server_key_iv: "7cc92664476c935fceb27f842820db20"
server_key_version: "encryptionkey@0"
I20260924 17:33:56.148443 14140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.149204 14155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.149410 14140 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.149513 14140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "840528a7b6944faeb3dc882867c05892"
format_stamp: "Formatted at 2026-09-24 17:33:56 on dist-test-slave-gcz9"
server_key: "d4335a2fe5b29b22cd921b302e5e8957"
server_key_iv: "7cc92664476c935fceb27f842820db20"
server_key_version: "encryptionkey@0"
I20260924 17:33:56.149609 14140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:56.172319 14140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:56.174513 14140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:56.174676 14140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:56.175275 14140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:56.175314 14140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.175339 14140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:56.175356 14140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271236, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:56.182760 14140 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:36805
I20260924 17:33:56.182855 14272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:36805 every 8 connection(s)
I20260924 17:33:56.183220 14140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:33:56.184965 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 14140
I20260924 17:33:56.185093 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:33:56.185286 6292 external_mini_cluster.cc:1428] Setting key fe197005cf98b108e7b8311a0474a37d
I20260924 17:33:56.185417 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.175853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:35631 (local address 127.6.37.62:36685)
0924 17:33:56.175901 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.175907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.176158 (+ 251us) server_negotiation.cc:407] Connection header received
0924 17:33:56.176775 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.176777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.176791 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.176864 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.177535 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.178371 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.179542 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.179897 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.179971 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.182221 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.182223 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.182223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.182230 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.184004 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.184417 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.184418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.184419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.184482 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.184741 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.184742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.184742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.184867 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.184940 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.185242 (+ 302us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.185321 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:33:56.185612 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.175852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.6.37.2:35631)
0924 17:33:56.176035 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.176071 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.176643 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.176972 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.176976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.177216 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.177428 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.177433 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.178478 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.178479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.179449 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.179452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.180002 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.180003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.180118 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.180647 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.180658 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.182127 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.184101 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.184108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.184110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.184339 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.184550 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.184551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.184552 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.184664 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.184946 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.184954 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.185112 (+ 158us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.185219 (+ 107us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.185385 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":100,"threads_started":1}
I20260924 17:33:56.186281 14274 heartbeater.cc:347] Connected to a master server at 127.6.37.62:36685
I20260924 17:33:56.186375 14274 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:56.186610 14274 heartbeater.cc:511] Master 127.6.37.62:36685 requested a full tablet report, sending...
I20260924 17:33:56.187076 13925 ts_manager.cc:194] Registered new tserver with Master: 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:56.187454 13925 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:35631
I20260924 17:33:56.194036 14281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.187762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.6.37.2:52065)
0924 17:33:56.187891 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.187902 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.187953 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.188415 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.188416 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.188645 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.188710 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.188712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.189425 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.189427 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.190343 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.190346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.190676 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.190677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.190749 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.191237 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.191242 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.191514 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.192974 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.192975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.192976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.193141 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.193348 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.193349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.193349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.193411 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.193699 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.193700 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.193743 (+ 43us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.193828 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.193930 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260924 17:33:56.194028 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.187828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:52065 (local address 127.6.37.62:36685)
0924 17:33:56.188293 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.188295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.188302 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:33:56.188318 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.188319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.188327 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.188407 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.188786 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.189298 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.190419 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.190598 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.190676 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.191616 (+ 940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.191617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.191618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.191624 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.192881 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.193212 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.193213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.193213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.193266 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.193478 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.193479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.193480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.193622 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.193695 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.193854 (+ 159us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.193931 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445}
WARNING: no policy specified for oryx/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab.
Entry for principal oryx/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab.
I20260924 17:33:56.214432 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:36685
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:56.297423 14284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:56.297643 14284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:56.297667 14284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:56.298748 14284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:56.298811 14284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:56.298919 14284 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260924 17:33:56.298964 14284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:33:56.300493 14284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.37.62:36685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:56.300686 14284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:56.300868 14284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:56.305681 14292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:56.305701 14290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:56.305745 14289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:56.305938 14284 server_base.cc:1034] running on GCE node
I20260924 17:33:56.306233 14284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:56.306488 14284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:56.307657 14284 hybrid_clock.cc:648] HybridClock initialized: now 1790271236307642 us; error 45 us; skew 500 ppm
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271236, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:56.319204 14284 init.cc:377] Logged in from keytab as oryx/127.6.37.3@KRBTEST.COM (short username oryx)
I20260924 17:33:56.319701 14284 webserver.cc:460] Webserver started at http://127.6.37.3:46813/ using document root <none> and password file <none>
I20260924 17:33:56.319983 14284 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:56.320057 14284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:56.320204 14284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:56.321358 14284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "445c8e0f2537479c9f5a3ef7afb1ae67"
format_stamp: "Formatted at 2026-09-24 17:33:56 on dist-test-slave-gcz9"
server_key: "a24d945d21e435def13513142f38eff7"
server_key_iv: "fea831ffc64772d50f14cef7bf75065d"
server_key_version: "encryptionkey@0"
I20260924 17:33:56.321719 14284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "445c8e0f2537479c9f5a3ef7afb1ae67"
format_stamp: "Formatted at 2026-09-24 17:33:56 on dist-test-slave-gcz9"
server_key: "a24d945d21e435def13513142f38eff7"
server_key_iv: "fea831ffc64772d50f14cef7bf75065d"
server_key_version: "encryptionkey@0"
I20260924 17:33:56.323208 14284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:33:56.324041 14299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.324272 14284 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.324373 14284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "445c8e0f2537479c9f5a3ef7afb1ae67"
format_stamp: "Formatted at 2026-09-24 17:33:56 on dist-test-slave-gcz9"
server_key: "a24d945d21e435def13513142f38eff7"
server_key_iv: "fea831ffc64772d50f14cef7bf75065d"
server_key_version: "encryptionkey@0"
I20260924 17:33:56.324455 14284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:56.336418 14284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:33:56.338438 14284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:33:56.338588 14284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:33:56.339161 14284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:33:56.339217 14284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.339258 14284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:33:56.339289 14284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271236, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:56.346638 14284 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:33471
I20260924 17:33:56.346684 14416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:33471 every 8 connection(s)
I20260924 17:33:56.347078 14284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:33:56.349184 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.339566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:34629 (local address 127.6.37.62:36685)
0924 17:33:56.339629 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.339631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.339898 (+ 267us) server_negotiation.cc:407] Connection header received
0924 17:33:56.340391 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.340393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.340405 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.340458 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.341241 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.342082 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.343855 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.344181 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.344258 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.346495 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.346496 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.346497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.346505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.348045 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.348393 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.348394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.348394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.348443 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.348616 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.348617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.348617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.348711 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.348759 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.348978 (+ 219us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.349082 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:33:56.349184 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 14284
I20260924 17:33:56.349216 14308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.339558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.6.37.3:34629)
0924 17:33:56.339699 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.339731 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.340282 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.340536 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.340540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.340857 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.341145 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.341151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.342213 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.342215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.343733 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.343737 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.344282 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.344283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.344412 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.344890 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.344904 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.346364 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.348117 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.348121 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.348123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.348327 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.348482 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.348483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.348483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.348567 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.348768 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.348773 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.348878 (+ 105us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.348955 (+ 77us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.349073 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260924 17:33:56.349264 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:33:56.349472 6292 external_mini_cluster.cc:1428] Setting key 8867be770bce1ff4db1f393e0512c5dd
I20260924 17:33:56.350518 14417 heartbeater.cc:347] Connected to a master server at 127.6.37.62:36685
I20260924 17:33:56.350600 14417 heartbeater.cc:464] Registering TS with master...
I20260924 17:33:56.350767 14417 heartbeater.cc:511] Master 127.6.37.62:36685 requested a full tablet report, sending...
I20260924 17:33:56.351107 13925 ts_manager.cc:194] Registered new tserver with Master: 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471)
I20260924 17:33:56.351495 13925 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:34629
I20260924 17:33:56.355984 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.350688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:41503 (local address 127.6.37.62:36685)
0924 17:33:56.350724 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.350725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.350782 (+ 57us) server_negotiation.cc:407] Connection header received
0924 17:33:56.350911 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.350912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.350921 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.350977 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.351303 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.351991 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.352754 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.352956 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.353044 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.353870 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.353871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.353871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.353877 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.354865 (+ 988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.355226 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.355227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.355227 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.355278 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.355501 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.355502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.355502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.355605 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.355675 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.355836 (+ 161us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.355899 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:33:56.356001 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.350603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.6.37.3:41503)
0924 17:33:56.350725 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.350736 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.350795 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.350983 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.350984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.351177 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.351235 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.351237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.352086 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.352087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.352658 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.352660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.353056 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.353057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.353119 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.353520 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.353524 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.353768 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.354987 (+ 1219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.354988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.354988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.355151 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.355360 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.355361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.355362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.355416 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.355682 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.355683 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.355723 (+ 40us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.355806 (+ 83us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.355900 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":70,"threads_started":1}
I20260924 17:33:56.360987 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271236, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
W20260924 17:33:56.382030 13975 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:56.376630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.6.37.62:36685)
0924 17:33:56.376695 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.376698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.376724 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:33:56.376755 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.376755 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.376764 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.376841 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.377402 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.377920 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.378695 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.378945 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.379026 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.381916 (+ 2890us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49024: BlockingRecv error: recv got EOF from 127.0.0.1:49024 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271236, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:56.389370 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.382683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49038 (local address 127.6.37.62:36685)
0924 17:33:56.382738 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.382739 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.382772 (+ 33us) server_negotiation.cc:407] Connection header received
0924 17:33:56.382835 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.382836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.382842 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.382948 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.383370 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.383803 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.384429 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.384598 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.384645 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.386659 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.386660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.386661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.386668 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.388261 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.388596 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.388597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.388597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.388653 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.388864 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.388865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.388865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.388972 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.389076 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.389200 (+ 124us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.389270 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260924 17:33:56.391179 13925 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:56.392750 13925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:56.399924 14440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.395494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:36805 (local address 127.0.0.1:52044)
0924 17:33:56.396435 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.396446 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.396497 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.396674 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.396675 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.396677 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.396734 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.396736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.397972 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.397973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.398662 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.398664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.399597 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.399598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.399687 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.399702 (+ 15us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.399770 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.399823 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":923,"thread_start_us":75,"threads_started":1}
I20260924 17:33:56.400110 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.395860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48712 (local address 127.6.37.3:33471)
0924 17:33:56.396058 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.396062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.396071 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:56.396109 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.396112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.396128 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.396203 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.396400 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.397265 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.398820 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.399579 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.399654 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.399727 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.399969 (+ 242us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.400010 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":88,"threads_started":1}
I20260924 17:33:56.399924 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.395617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52044 (local address 127.6.37.2:36805)
0924 17:33:56.396183 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.396187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.396520 (+ 333us) server_negotiation.cc:407] Connection header received
0924 17:33:56.396565 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.396568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.396583 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.396663 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.396807 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.397894 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.398751 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.399491 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.399585 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.399672 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.399783 (+ 111us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.399820 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":136,"threads_started":1}
I20260924 17:33:56.400416 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.395655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43656 (local address 127.6.37.1:33741)
0924 17:33:56.395830 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.395836 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.395847 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:33:56.395889 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.395892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.395908 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.396047 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.396190 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.397200 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.398829 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.399580 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.399939 (+ 359us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.400023 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.400047 (+ 24us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.400323 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
I20260924 17:33:56.400554 14441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.395275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:33471 (local address 127.0.0.1:48712)
0924 17:33:56.395845 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.395855 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.395954 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.396271 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.396272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.396274 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.396323 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.396324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.397357 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.397358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.398715 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.398718 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.399756 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.399757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.399815 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.399818 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.399862 (+ 44us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.399897 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":33,"thread_start_us":84,"threads_started":1}
I20260924 17:33:56.400929 14207 tablet_service.cc:1467] Processing CreateTablet for tablet e9e8f912c1f846da940c661d80ffd146 (DEFAULT_TABLE table=test-table [id=28b905492af04efd8ac4240dc6430eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:56.401278 14207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e8f912c1f846da940c661d80ffd146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.404536 14445 tablet_bootstrap.cc:492] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Bootstrap starting.
I20260924 17:33:56.404737 14439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.395270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:33741 (local address 127.0.0.1:43656)
0924 17:33:56.395386 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.395426 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.395486 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.396050 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.396053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.396055 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.396115 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.396116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.397296 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.397298 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.398720 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.398722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.399684 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.399685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.399764 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.399768 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.399806 (+ 38us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.399857 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":78,"thread_start_us":71,"threads_started":1}
I20260924 17:33:56.405061 14349 tablet_service.cc:1467] Processing CreateTablet for tablet e9e8f912c1f846da940c661d80ffd146 (DEFAULT_TABLE table=test-table [id=28b905492af04efd8ac4240dc6430eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:56.405320 14445 tablet_bootstrap.cc:654] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.405350 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e8f912c1f846da940c661d80ffd146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.405467 14046 tablet_service.cc:1467] Processing CreateTablet for tablet e9e8f912c1f846da940c661d80ffd146 (DEFAULT_TABLE table=test-table [id=28b905492af04efd8ac4240dc6430eb1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:56.405691 14445 log.cc:824] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:56.405798 14046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9e8f912c1f846da940c661d80ffd146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.406584 14445 tablet_bootstrap.cc:492] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: No bootstrap required, opened a new log
I20260924 17:33:56.406659 14445 ts_tablet_manager.cc:1397] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:33:56.408459 14447 tablet_bootstrap.cc:492] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Bootstrap starting.
I20260924 17:33:56.409055 14447 tablet_bootstrap.cc:654] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.408912 14445 raft_consensus.cc:348] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.409122 14445 raft_consensus.cc:374] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.409173 14445 raft_consensus.cc:729] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840528a7b6944faeb3dc882867c05892, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.409288 14445 consensus_queue.cc:260] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.409426 14447 log.cc:824] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:56.409607 14445 ts_tablet_manager.cc:1428] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:33:56.409654 14274 heartbeater.cc:503] Master 127.6.37.62:36685 was elected leader, sending a full tablet report...
I20260924 17:33:56.409951 14449 tablet_bootstrap.cc:492] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Bootstrap starting.
I20260924 17:33:56.410303 14447 tablet_bootstrap.cc:492] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: No bootstrap required, opened a new log
I20260924 17:33:56.410389 14447 ts_tablet_manager.cc:1397] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:56.410785 14449 tablet_bootstrap.cc:654] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.411103 14449 log.cc:824] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Log is configured to *not* fsync() on all Append() calls
I20260924 17:33:56.411866 14449 tablet_bootstrap.cc:492] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: No bootstrap required, opened a new log
I20260924 17:33:56.411952 14449 ts_tablet_manager.cc:1397] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:56.412099 14447 raft_consensus.cc:348] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.412222 14447 raft_consensus.cc:374] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.412243 14447 raft_consensus.cc:729] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.412379 14447 consensus_queue.cc:260] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.412635 14447 ts_tablet_manager.cc:1428] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:33:56.412703 14417 heartbeater.cc:503] Master 127.6.37.62:36685 was elected leader, sending a full tablet report...
I20260924 17:33:56.413874 14449 raft_consensus.cc:348] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.414013 14449 raft_consensus.cc:374] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.414057 14449 raft_consensus.cc:729] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.414166 14449 consensus_queue.cc:260] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.414435 14449 ts_tablet_manager.cc:1428] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 17:33:56.414458 14130 heartbeater.cc:503] Master 127.6.37.62:36685 was elected leader, sending a full tablet report...
W20260924 17:33:56.433882 14275 tablet.cc:2369] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:33:56.516216 14132 tablet.cc:2369] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:33:56.597911 14418 tablet.cc:2369] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:33:56.659044 14453 raft_consensus.cc:482] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:56.659230 14453 raft_consensus.cc:504] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.659669 14453 leader_election.cc:288] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471), 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:56.663718 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.660027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:44345 (local address 127.6.37.3:33471)
0924 17:33:56.660073 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.660074 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.660083 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:33:56.660106 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.660107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.660117 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.660187 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.660370 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.661142 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.662709 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.663341 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.663421 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.663432 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.663601 (+ 169us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.663645 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:33:56.663718 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.660002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:49833 (local address 127.6.37.2:36805)
0924 17:33:56.660051 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.660054 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.660068 (+ 14us) server_negotiation.cc:407] Connection header received
0924 17:33:56.660103 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.660104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.660117 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.660187 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.660375 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.661109 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.662709 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.663336 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.663421 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.663432 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.663601 (+ 169us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.663644 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:33:56.663791 14454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.659854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:36805 (local address 127.6.37.1:49833)
0924 17:33:56.659962 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.659976 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.660044 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.660211 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.660212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.660214 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.660287 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.660290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.661223 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.661224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.662591 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.662594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.663437 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.663438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.663526 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.663529 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.663580 (+ 51us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.663645 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":95,"thread_start_us":64,"threads_started":1}
I20260924 17:33:56.663795 14455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.659857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:33471 (local address 127.6.37.1:44345)
0924 17:33:56.659985 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.660010 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.660048 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.660211 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.660212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.660218 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.660287 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.660290 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.661224 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.661225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.662591 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.662594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.663435 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.663437 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.663512 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.663517 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.663580 (+ 63us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.663646 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":75,"thread_start_us":67,"threads_started":1}
I20260924 17:33:56.664187 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e8f912c1f846da940c661d80ffd146" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892" is_pre_election: true
I20260924 17:33:56.664402 14227 raft_consensus.cc:2454] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 0.
I20260924 17:33:56.664489 14371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e8f912c1f846da940c661d80ffd146" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" is_pre_election: true
I20260924 17:33:56.664637 14015 leader_election.cc:302] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5644065e044b435b92b36e8d5ace80e2, 840528a7b6944faeb3dc882867c05892; no voters:
I20260924 17:33:56.664664 14371 raft_consensus.cc:2454] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 0.
I20260924 17:33:56.664813 14453 raft_consensus.cc:2781] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:56.664871 14453 raft_consensus.cc:482] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:56.664913 14453 raft_consensus.cc:3037] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.665627 14453 raft_consensus.cc:504] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.665776 14453 leader_election.cc:288] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 election: Requested vote from peers 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471), 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:56.665926 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e8f912c1f846da940c661d80ffd146" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892"
I20260924 17:33:56.665932 14371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9e8f912c1f846da940c661d80ffd146" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67"
I20260924 17:33:56.666002 14227 raft_consensus.cc:3037] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.666002 14371 raft_consensus.cc:3037] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.666850 14227 raft_consensus.cc:2454] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 1.
I20260924 17:33:56.666854 14371 raft_consensus.cc:2454] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 1.
I20260924 17:33:56.667112 14017 leader_election.cc:302] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 5644065e044b435b92b36e8d5ace80e2; no voters:
I20260924 17:33:56.667234 14453 raft_consensus.cc:2781] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:56.667384 14453 raft_consensus.cc:686] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Running, Role: LEADER
I20260924 17:33:56.667519 14453 consensus_queue.cc:237] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } }
I20260924 17:33:56.668311 13925 catalog_manager.cc:5495] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1). New cstate: current_term: 1 leader_uuid: "5644065e044b435b92b36e8d5ace80e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:56.680048 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.677597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43670 (local address 127.6.37.1:33741)
0924 17:33:56.677666 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.677667 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.677674 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:33:56.677701 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.677702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.677718 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.677796 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:56.677940 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.678404 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.679229 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.679439 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.679532 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.679732 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:56.679837 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:56.679931 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.679951 (+ 20us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.679971 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260924 17:33:56.681895 14227 raft_consensus.cc:1261] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Refusing update from remote peer 5644065e044b435b92b36e8d5ace80e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:56.681895 14371 raft_consensus.cc:1261] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Refusing update from remote peer 5644065e044b435b92b36e8d5ace80e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:56.682242 14456 consensus_queue.cc:1035] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:56.682437 14453 consensus_queue.cc:1035] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:56.684921 14459 mvcc.cc:205] Tried to move back new op lower bound from 7332950985446080512 to 7332950985390710784. Current Snapshot: MvccSnapshot[applied={T|T < 7332950985446080512}]
I20260924 17:33:56.685286 14461 mvcc.cc:205] Tried to move back new op lower bound from 7332950985446080512 to 7332950985390710784. Current Snapshot: MvccSnapshot[applied={T|T < 7332950985446080512}]
I20260924 17:33:56.686122 14460 mvcc.cc:205] Tried to move back new op lower bound from 7332950985446080512 to 7332950985390710784. Current Snapshot: MvccSnapshot[applied={T|T < 7332950985446080512}]
I20260924 17:33:56.687721 13925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:56.687814 13925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:56.688545 13925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Sending DeleteTablet for 3 replicas of tablet e9e8f912c1f846da940c661d80ffd146
I20260924 17:33:56.688863 14046 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e8f912c1f846da940c661d80ffd146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:56 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:43656
I20260924 17:33:56.688867 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e8f912c1f846da940c661d80ffd146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:56 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:48712
I20260924 17:33:56.688923 14207 tablet_service.cc:1514] Processing DeleteTablet for tablet e9e8f912c1f846da940c661d80ffd146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:56 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:52044
I20260924 17:33:56.689095 14471 tablet_replica.cc:330] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: stopping tablet replica
I20260924 17:33:56.689150 14470 tablet_replica.cc:330] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: stopping tablet replica
I20260924 17:33:56.689251 14471 raft_consensus.cc:2229] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:56.689265 14470 raft_consensus.cc:2229] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:56.689417 14470 raft_consensus.cc:2258] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:56.689442 14471 raft_consensus.cc:2258] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:56.689426 13925 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:56.689580 13925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:56.689977 14471 ts_tablet_manager.cc:1905] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:56.690395 14470 ts_tablet_manager.cc:1905] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:56.690750 14046 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0ec48c62d942ada4d178733c6224d9 (DEFAULT_TABLE table=test-table [id=4c73cdeeb0034737ac18345be7cd2242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:56.690858 14046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0ec48c62d942ada4d178733c6224d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.691159 14349 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0ec48c62d942ada4d178733c6224d9 (DEFAULT_TABLE table=test-table [id=4c73cdeeb0034737ac18345be7cd2242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:56.691277 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0ec48c62d942ada4d178733c6224d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.692068 14471 ts_tablet_manager.cc:1918] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:56.692158 14471 log.cc:1196] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/e9e8f912c1f846da940c661d80ffd146
I20260924 17:33:56.692230 14470 ts_tablet_manager.cc:1918] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:56.692250 14207 tablet_service.cc:1467] Processing CreateTablet for tablet 7d0ec48c62d942ada4d178733c6224d9 (DEFAULT_TABLE table=test-table [id=4c73cdeeb0034737ac18345be7cd2242]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:56.692293 14470 log.cc:1196] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/e9e8f912c1f846da940c661d80ffd146
I20260924 17:33:56.692344 14207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d0ec48c62d942ada4d178733c6224d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.692428 14471 ts_tablet_manager.cc:1939] T e9e8f912c1f846da940c661d80ffd146 P 840528a7b6944faeb3dc882867c05892: Deleting consensus metadata
I20260924 17:33:56.692570 14470 ts_tablet_manager.cc:1939] T e9e8f912c1f846da940c661d80ffd146 P 5644065e044b435b92b36e8d5ace80e2: Deleting consensus metadata
I20260924 17:33:56.692725 14449 tablet_bootstrap.cc:492] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Bootstrap starting.
I20260924 17:33:56.693120 14449 tablet_bootstrap.cc:654] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.693359 14447 tablet_bootstrap.cc:492] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Bootstrap starting.
I20260924 17:33:56.693390 14445 tablet_bootstrap.cc:492] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Bootstrap starting.
I20260924 17:33:56.693706 14449 tablet_bootstrap.cc:492] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: No bootstrap required, opened a new log
I20260924 17:33:56.693737 14447 tablet_bootstrap.cc:654] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.693749 14449 ts_tablet_manager.cc:1397] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.693944 14445 tablet_bootstrap.cc:654] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.693904 14449 raft_consensus.cc:348] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.693979 14449 raft_consensus.cc:374] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.694006 14449 raft_consensus.cc:729] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.694062 14449 consensus_queue.cc:260] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.694168 14449 ts_tablet_manager.cc:1428] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.694438 14447 tablet_bootstrap.cc:492] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: No bootstrap required, opened a new log
I20260924 17:33:56.694483 14447 ts_tablet_manager.cc:1397] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.694643 14447 raft_consensus.cc:348] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.694787 14447 raft_consensus.cc:374] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.694837 14447 raft_consensus.cc:729] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.694898 14447 consensus_queue.cc:260] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.694880 13911 catalog_manager.cc:4841] TS 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805): tablet e9e8f912c1f846da940c661d80ffd146 (table test-table [id=28b905492af04efd8ac4240dc6430eb1]) successfully deleted
I20260924 17:33:56.694996 14447 ts_tablet_manager.cc:1428] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260924 17:33:56.695084 13911 catalog_manager.cc:4841] TS 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741): tablet e9e8f912c1f846da940c661d80ffd146 (table test-table [id=28b905492af04efd8ac4240dc6430eb1]) successfully deleted
I20260924 17:33:56.695564 14445 tablet_bootstrap.cc:492] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: No bootstrap required, opened a new log
I20260924 17:33:56.695636 14445 ts_tablet_manager.cc:1397] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:56.695766 14445 raft_consensus.cc:348] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.695837 14445 raft_consensus.cc:374] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.695870 14445 raft_consensus.cc:729] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840528a7b6944faeb3dc882867c05892, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.695921 14445 consensus_queue.cc:260] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.696003 14445 ts_tablet_manager.cc:1428] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.705442 14469 tablet_replica.cc:330] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: stopping tablet replica
I20260924 17:33:56.705614 14469 raft_consensus.cc:2229] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:56.705765 14469 raft_consensus.cc:2258] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:56.706241 14469 ts_tablet_manager.cc:1905] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:56.708132 14469 ts_tablet_manager.cc:1918] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:56.708223 14469 log.cc:1196] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/e9e8f912c1f846da940c661d80ffd146
I20260924 17:33:56.708469 14469 ts_tablet_manager.cc:1939] T e9e8f912c1f846da940c661d80ffd146 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting consensus metadata
I20260924 17:33:56.708890 13913 catalog_manager.cc:4841] TS 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471): tablet e9e8f912c1f846da940c661d80ffd146 (table test-table [id=28b905492af04efd8ac4240dc6430eb1]) successfully deleted
I20260924 17:33:56.776273 14448 raft_consensus.cc:482] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:56.776391 14448 raft_consensus.cc:504] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.776746 14448 leader_election.cc:288] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741), 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471)
I20260924 17:33:56.780315 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.776993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:47979 (local address 127.6.37.1:33741)
0924 17:33:56.777037 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.777039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.777123 (+ 84us) server_negotiation.cc:407] Connection header received
0924 17:33:56.777246 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.777247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.777257 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.777289 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.777544 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.778271 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.779537 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.779927 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.780033 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.780045 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.780215 (+ 170us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.780251 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:33:56.780339 14476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.776916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:33741 (local address 127.6.37.2:47979)
0924 17:33:56.777057 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.777069 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.777158 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.777361 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.777362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.777366 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.777436 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.777437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.778360 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.778361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.779452 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.779454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.780047 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.780048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.780129 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.780135 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.780196 (+ 61us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.780241 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":2,"thread_start_us":59,"threads_started":1}
I20260924 17:33:56.780431 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.777090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:47859 (local address 127.6.37.3:33471)
0924 17:33:56.777134 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.777136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.777197 (+ 61us) server_negotiation.cc:407] Connection header received
0924 17:33:56.777251 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.777253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.777262 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.777316 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.777505 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.777989 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.779390 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.780016 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.780091 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.780102 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.780323 (+ 221us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.780361 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:33:56.780673 14475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.776916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:33471 (local address 127.6.37.2:47859)
0924 17:33:56.777101 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.777111 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.777190 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.777339 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.777340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.777342 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.777419 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.777421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.778076 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.778077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.779297 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.779300 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.780158 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.780160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.780240 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.780243 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.780515 (+ 272us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.780566 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":25,"thread_start_us":62,"threads_started":1}
I20260924 17:33:56.780818 14084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0ec48c62d942ada4d178733c6224d9" candidate_uuid: "840528a7b6944faeb3dc882867c05892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5644065e044b435b92b36e8d5ace80e2" is_pre_election: true
I20260924 17:33:56.780959 14084 raft_consensus.cc:2454] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 840528a7b6944faeb3dc882867c05892 in term 0.
I20260924 17:33:56.781066 14371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0ec48c62d942ada4d178733c6224d9" candidate_uuid: "840528a7b6944faeb3dc882867c05892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" is_pre_election: true
I20260924 17:33:56.781163 14371 raft_consensus.cc:2454] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 840528a7b6944faeb3dc882867c05892 in term 0.
I20260924 17:33:56.781183 14157 leader_election.cc:302] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5644065e044b435b92b36e8d5ace80e2, 840528a7b6944faeb3dc882867c05892; no voters:
I20260924 17:33:56.781311 14448 raft_consensus.cc:2781] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:56.781347 14448 raft_consensus.cc:482] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:56.781368 14448 raft_consensus.cc:3037] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.782087 14448 raft_consensus.cc:504] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.782228 14448 leader_election.cc:288] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [CANDIDATE]: Term 1 election: Requested vote from peers 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741), 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471)
I20260924 17:33:56.782423 14371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0ec48c62d942ada4d178733c6224d9" candidate_uuid: "840528a7b6944faeb3dc882867c05892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67"
I20260924 17:33:56.782462 14084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d0ec48c62d942ada4d178733c6224d9" candidate_uuid: "840528a7b6944faeb3dc882867c05892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5644065e044b435b92b36e8d5ace80e2"
I20260924 17:33:56.782517 14371 raft_consensus.cc:3037] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.782522 14084 raft_consensus.cc:3037] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.783309 14084 raft_consensus.cc:2454] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840528a7b6944faeb3dc882867c05892 in term 1.
I20260924 17:33:56.783309 14371 raft_consensus.cc:2454] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 840528a7b6944faeb3dc882867c05892 in term 1.
I20260924 17:33:56.783491 14159 leader_election.cc:302] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 840528a7b6944faeb3dc882867c05892; no voters:
I20260924 17:33:56.783589 14448 raft_consensus.cc:2781] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:56.783746 14448 raft_consensus.cc:686] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 1 LEADER]: Becoming Leader. State: Replica: 840528a7b6944faeb3dc882867c05892, State: Running, Role: LEADER
I20260924 17:33:56.783816 14448 consensus_queue.cc:237] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.784559 13925 catalog_manager.cc:5495] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 reported cstate change: term changed from 0 to 1, leader changed from <none> to 840528a7b6944faeb3dc882867c05892 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "840528a7b6944faeb3dc882867c05892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } health_report { overall_health: UNKNOWN } } }
Sep 24 17:33:56 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271235, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.62@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:56.810938 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.803662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49052 (local address 127.6.37.62:36685)
0924 17:33:56.803711 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.803713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.803818 (+ 105us) server_negotiation.cc:407] Connection header received
0924 17:33:56.803887 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.803887 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.803895 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.803944 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:56.804503 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.804974 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.805979 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.806150 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.806196 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.808259 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:56.808260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:56.808261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:56.808268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:56.809650 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.810088 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.810089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.810090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.810146 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:56.810357 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:56.810357 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:56.810358 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:56.810462 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:56.810552 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.810709 (+ 157us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.810792 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260924 17:33:56.811024 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.803571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:36685 (local address 127.0.0.1:49052)
0924 17:33:56.803741 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.803754 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.803825 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.803970 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.803971 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.804371 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:33:56.804427 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.804429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.805053 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.805054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.805911 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.805912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.806214 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.806215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.806271 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.806761 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:33:56.806766 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:33:56.808169 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:33:56.809799 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.809806 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.809809 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.810011 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.810211 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:33:56.810212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:33:56.810212 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:33:56.810275 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:33:56.810547 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:33:56.810554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:33:56.810600 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.810687 (+ 87us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.810862 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":76,"thread_start_us":88,"threads_started":1}
I20260924 17:33:56.813119 13926 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:49052:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260924 17:33:56.813316 13926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:56.814821 14349 tablet_service.cc:1467] Processing CreateTablet for tablet e6c6173e284245afb06de51aa9aebdcd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bdbcb1c3e16546c58305bf63c8402ac0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:56.814838 14046 tablet_service.cc:1467] Processing CreateTablet for tablet e6c6173e284245afb06de51aa9aebdcd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bdbcb1c3e16546c58305bf63c8402ac0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:56.814823 14207 tablet_service.cc:1467] Processing CreateTablet for tablet e6c6173e284245afb06de51aa9aebdcd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bdbcb1c3e16546c58305bf63c8402ac0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260924 17:33:56.815009 14207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c6173e284245afb06de51aa9aebdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.815011 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c6173e284245afb06de51aa9aebdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.815019 14046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6c6173e284245afb06de51aa9aebdcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:56.816473 14449 tablet_bootstrap.cc:492] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: Bootstrap starting.
I20260924 17:33:56.816471 14447 tablet_bootstrap.cc:492] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: Bootstrap starting.
I20260924 17:33:56.816781 14449 tablet_bootstrap.cc:654] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.816859 14447 tablet_bootstrap.cc:654] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.817196 14445 tablet_bootstrap.cc:492] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: Bootstrap starting.
I20260924 17:33:56.817564 14449 tablet_bootstrap.cc:492] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: No bootstrap required, opened a new log
I20260924 17:33:56.817580 14445 tablet_bootstrap.cc:654] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:56.817597 14449 ts_tablet_manager.cc:1397] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.817674 14449 raft_consensus.cc:348] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.817719 14449 raft_consensus.cc:374] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.817732 14449 raft_consensus.cc:729] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.817767 14449 consensus_queue.cc:260] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.817826 14449 ts_tablet_manager.cc:1428] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.817875 14453 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:56.817970 14453 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:56.818043 14447 tablet_bootstrap.cc:492] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: No bootstrap required, opened a new log
I20260924 17:33:56.818099 14447 ts_tablet_manager.cc:1397] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260924 17:33:56.818246 14447 raft_consensus.cc:348] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.818310 14447 raft_consensus.cc:374] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.818337 14447 raft_consensus.cc:729] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.818403 14447 consensus_queue.cc:260] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.818490 14447 ts_tablet_manager.cc:1428] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:56.818475 14445 tablet_bootstrap.cc:492] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: No bootstrap required, opened a new log
I20260924 17:33:56.818548 14445 ts_tablet_manager.cc:1397] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:56.818542 14452 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:56.818624 14452 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:56.818694 14445 raft_consensus.cc:348] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.818782 14445 raft_consensus.cc:374] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:56.818809 14445 raft_consensus.cc:729] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840528a7b6944faeb3dc882867c05892, State: Initialized, Role: FOLLOWER
I20260924 17:33:56.818858 14445 consensus_queue.cc:260] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.819005 14445 ts_tablet_manager.cc:1428] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:56.819087 14448 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:56.819187 14448 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:56.975106 14452 raft_consensus.cc:482] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:56.975206 14452 raft_consensus.cc:504] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.975554 14452 leader_election.cc:288] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741), 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:56.978690 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.976081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:38215 (local address 127.6.37.2:36805)
0924 17:33:56.976159 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.976161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.976171 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:56.976236 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.976237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.976248 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.976308 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.976466 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.976938 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.977970 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.978332 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.978415 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.978426 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.978575 (+ 149us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.978611 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260924 17:33:56.978713 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.975833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:49027 (local address 127.6.37.1:33741)
0924 17:33:56.975902 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.975904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.976002 (+ 98us) server_negotiation.cc:407] Connection header received
0924 17:33:56.976117 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.976119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.976135 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.976176 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:33:56.976455 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.976978 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.977997 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.978359 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.978440 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.978455 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:56.978604 (+ 149us) server_negotiation.cc:299] Negotiation successful
0924 17:33:56.978642 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260924 17:33:56.978739 14489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.975981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:36805 (local address 127.6.37.3:38215)
0924 17:33:56.976101 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.976112 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.976186 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.976319 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.976320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.976322 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.976388 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.976389 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.977051 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.977052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.977873 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.977875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.978414 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.978416 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.978492 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.978501 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.978569 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.978610 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":2,"thread_start_us":41,"threads_started":1}
I20260924 17:33:56.978749 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.975761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:33741 (local address 127.6.37.3:49027)
0924 17:33:56.975912 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.975924 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.975993 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.976260 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.976261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.976263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:33:56.976379 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.976381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.977069 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.977070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.977888 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.977890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.978442 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.978443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:56.978524 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:56.978527 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:33:56.978595 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 17:33:56.978641 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":48,"thread_start_us":100,"threads_started":1}
I20260924 17:33:56.979081 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c6173e284245afb06de51aa9aebdcd" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892" is_pre_election: true
I20260924 17:33:56.979094 14084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c6173e284245afb06de51aa9aebdcd" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5644065e044b435b92b36e8d5ace80e2" is_pre_election: true
I20260924 17:33:56.979202 14084 raft_consensus.cc:2454] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 0.
I20260924 17:33:56.979189 14227 raft_consensus.cc:2454] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 0.
I20260924 17:33:56.979379 14301 leader_election.cc:302] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 840528a7b6944faeb3dc882867c05892; no voters:
I20260924 17:33:56.979503 14452 raft_consensus.cc:2781] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:56.979543 14452 raft_consensus.cc:482] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:56.979571 14452 raft_consensus.cc:3037] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.980257 14452 raft_consensus.cc:504] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.980397 14452 leader_election.cc:288] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 election: Requested vote from peers 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741), 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:56.980563 14084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c6173e284245afb06de51aa9aebdcd" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5644065e044b435b92b36e8d5ace80e2"
I20260924 17:33:56.980571 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6c6173e284245afb06de51aa9aebdcd" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892"
I20260924 17:33:56.980656 14227 raft_consensus.cc:3037] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.980659 14084 raft_consensus.cc:3037] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:56.981344 14227 raft_consensus.cc:2454] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 1.
I20260924 17:33:56.981379 14084 raft_consensus.cc:2454] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 1.
I20260924 17:33:56.981526 14301 leader_election.cc:302] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 840528a7b6944faeb3dc882867c05892; no voters:
I20260924 17:33:56.981628 14452 raft_consensus.cc:2781] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:56.981724 14452 raft_consensus.cc:686] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 LEADER]: Becoming Leader. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Running, Role: LEADER
I20260924 17:33:56.981806 14452 consensus_queue.cc:237] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:56.982191 14490 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: TxnStatusTablet state changed. Reason: New leader 445c8e0f2537479c9f5a3ef7afb1ae67. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:56.982291 14490 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:56.982605 14492 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260924 17:33:56.982719 14492 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260924 17:33:56.982645 13925 catalog_manager.cc:5495] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3). New cstate: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } health_report { overall_health: HEALTHY } } }
I20260924 17:33:57.001441 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.998710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48718 (local address 127.6.37.3:33471)
0924 17:33:56.998766 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:56.998769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:56.998779 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:33:56.998894 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:56.998895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:56.998913 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:56.998990 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:56.999152 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.999653 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.000599 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.000810 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.000888 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.001077 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.001181 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.001259 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.001324 (+ 65us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.001344 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260924 17:33:57.001442 14484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:56.998633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:33471 (local address 127.0.0.1:48718)
0924 17:33:56.998714 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:56.998728 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:56.998781 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:56.999009 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:56.999010 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:56.999012 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:56.999077 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:56.999080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:56.999740 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:56.999741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.000511 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.000514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.000889 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.000890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.000963 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.000977 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.001264 (+ 287us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.001273 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 17:33:57.001320 (+ 47us) client_negotiation.cc:240] Negotiation successful
0924 17:33:57.001368 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260924 17:33:57.002712 14227 raft_consensus.cc:1261] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Refusing update from remote peer 445c8e0f2537479c9f5a3ef7afb1ae67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.002763 14084 raft_consensus.cc:1261] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Refusing update from remote peer 445c8e0f2537479c9f5a3ef7afb1ae67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.003069 14452 consensus_queue.cc:1035] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.003218 14490 consensus_queue.cc:1035] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.003780 14448 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: TxnStatusTablet state changed. Reason: New leader 445c8e0f2537479c9f5a3ef7afb1ae67. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:57.003866 14448 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:57.003949 14453 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: TxnStatusTablet state changed. Reason: New leader 445c8e0f2537479c9f5a3ef7afb1ae67. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:57.004067 14453 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:57.004506 14452 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:57.004587 14452 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:57.004972 14448 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:57.005062 14448 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 840528a7b6944faeb3dc882867c05892: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:57.006002 14490 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:57.006093 14490 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 445c8e0f2537479c9f5a3ef7afb1ae67: This TxnStatusTablet replica's current role is: LEADER
I20260924 17:33:57.006305 14453 tablet_replica.cc:439] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } } }
I20260924 17:33:57.006381 14453 tablet_replica.cc:442] T e6c6173e284245afb06de51aa9aebdcd P 5644065e044b435b92b36e8d5ace80e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260924 17:33:57.009083 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.006489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52058 (local address 127.6.37.2:36805)
0924 17:33:57.006528 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.006529 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.006536 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:33:57.006570 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.006571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.006591 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.006660 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:57.006797 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.007566 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.008269 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.008582 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.008653 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.008761 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.008883 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.008954 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.008976 (+ 22us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.008996 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:33:57.014300 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.011579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:49477 (local address 127.6.37.3:33471)
0924 17:33:57.011638 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.011640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.011789 (+ 149us) server_negotiation.cc:407] Connection header received
0924 17:33:57.011844 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.011844 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.011852 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.011893 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:57.012017 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.012435 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.013583 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.013800 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.013877 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.014068 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.014097 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.014147 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.014221 (+ 74us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.014239 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260924 17:33:57.014366 14499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.011504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:33471 (local address 127.6.37.2:49477)
0924 17:33:57.011712 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:57.011723 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:57.011785 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:57.011905 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:57.011905 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:57.011907 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:57.011966 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.011967 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.012501 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.012502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.013452 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.013455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.013888 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.013889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.013965 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.013980 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.014163 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.014165 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:33:57.014217 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:33:57.014260 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":104,"threads_started":1}
I20260924 17:33:57.019239 14371 raft_consensus.cc:1261] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Refusing update from remote peer 840528a7b6944faeb3dc882867c05892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.019246 14084 raft_consensus.cc:1261] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Refusing update from remote peer 840528a7b6944faeb3dc882867c05892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.019767 14477 consensus_queue.cc:1035] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.019946 14448 consensus_queue.cc:1035] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.037108 14505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.034181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:36805 (local address 127.6.37.3:38329)
0924 17:33:57.034361 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:57.034372 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:57.034441 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:57.034565 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:57.034566 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:57.034567 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:57.034625 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.034626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.035509 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.035510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.036080 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.036082 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.036594 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.036595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.036666 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.036684 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.036928 (+ 244us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.036930 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:33:57.036974 (+ 44us) client_negotiation.cc:240] Negotiation successful
0924 17:33:57.037026 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":115,"threads_started":1}
I20260924 17:33:57.037092 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.034254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:38329 (local address 127.6.37.2:36805)
0924 17:33:57.034326 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.034328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.034438 (+ 110us) server_negotiation.cc:407] Connection header received
0924 17:33:57.034489 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.034490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.034500 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.034560 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:57.034668 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.035428 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.036159 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.036504 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.036574 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.036808 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.036843 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.036898 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.036992 (+ 94us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.037015 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260924 17:33:57.047524 13926 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:57.047647 13926 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49038:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:57.048298 13926 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Sending DeleteTablet for 3 replicas of tablet 7d0ec48c62d942ada4d178733c6224d9
I20260924 17:33:57.048538 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0ec48c62d942ada4d178733c6224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:48712
I20260924 17:33:57.048643 14469 tablet_replica.cc:330] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: stopping tablet replica
I20260924 17:33:57.048637 14207 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0ec48c62d942ada4d178733c6224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:52044
I20260924 17:33:57.048693 14469 raft_consensus.cc:2229] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:57.048718 14471 tablet_replica.cc:330] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: stopping tablet replica
I20260924 17:33:57.048728 14469 raft_consensus.cc:2258] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.048756 14471 raft_consensus.cc:2229] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:57.048841 14471 raft_consensus.cc:2258] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.049053 14046 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d0ec48c62d942ada4d178733c6224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:43656
I20260924 17:33:57.049072 14469 ts_tablet_manager.cc:1905] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.049331 14471 ts_tablet_manager.cc:1905] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.050630 14470 tablet_replica.cc:330] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: stopping tablet replica
I20260924 17:33:57.050720 14470 raft_consensus.cc:2229] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:57.050769 14470 raft_consensus.cc:2258] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.051000 14469 ts_tablet_manager.cc:1918] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:57.051065 14469 log.cc:1196] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/7d0ec48c62d942ada4d178733c6224d9
I20260924 17:33:57.051088 14470 ts_tablet_manager.cc:1905] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.051136 14471 ts_tablet_manager.cc:1918] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:57.051186 14471 log.cc:1196] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/7d0ec48c62d942ada4d178733c6224d9
I20260924 17:33:57.051285 14469 ts_tablet_manager.cc:1939] T 7d0ec48c62d942ada4d178733c6224d9 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting consensus metadata
I20260924 17:33:57.051409 14471 ts_tablet_manager.cc:1939] T 7d0ec48c62d942ada4d178733c6224d9 P 840528a7b6944faeb3dc882867c05892: Deleting consensus metadata
I20260924 17:33:57.051671 13913 catalog_manager.cc:4841] TS 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471): tablet 7d0ec48c62d942ada4d178733c6224d9 (table test-table [id=4c73cdeeb0034737ac18345be7cd2242]) successfully deleted
I20260924 17:33:57.052773 14470 ts_tablet_manager.cc:1918] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:57.052825 14470 log.cc:1196] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/7d0ec48c62d942ada4d178733c6224d9
I20260924 17:33:57.053047 14470 ts_tablet_manager.cc:1939] T 7d0ec48c62d942ada4d178733c6224d9 P 5644065e044b435b92b36e8d5ace80e2: Deleting consensus metadata
I20260924 17:33:57.054118 13911 catalog_manager.cc:4841] TS 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741): tablet 7d0ec48c62d942ada4d178733c6224d9 (table test-table [id=4c73cdeeb0034737ac18345be7cd2242]) successfully deleted
I20260924 17:33:57.054978 13911 catalog_manager.cc:4841] TS 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805): tablet 7d0ec48c62d942ada4d178733c6224d9 (table test-table [id=4c73cdeeb0034737ac18345be7cd2242]) successfully deleted
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
W20260924 17:33:57.081779 13975 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:33:57.076381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49054 (local address 127.6.37.62:36685)
0924 17:33:57.076432 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.076434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.076592 (+ 158us) server_negotiation.cc:407] Connection header received
0924 17:33:57.076682 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.076683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.076694 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.076762 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:57.077361 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.077864 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.078633 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.078833 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.078956 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.081730 (+ 2774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49054: BlockingRecv error: recv got EOF from 127.0.0.1:49054 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[13881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271237, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM
I20260924 17:33:57.091044 13975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.082859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.6.37.62:36685)
0924 17:33:57.082922 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.082924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.083125 (+ 201us) server_negotiation.cc:407] Connection header received
0924 17:33:57.083188 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.083189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.083199 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.083270 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:33:57.083733 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.084439 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.085212 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.085417 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.085518 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.088203 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:33:57.088204 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:33:57.088205 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:33:57.088212 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:33:57.089822 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:57.090185 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:57.090186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:57.090187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:57.090241 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:33:57.090495 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:33:57.090496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:33:57.090497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:33:57.090613 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:33:57.090715 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.090816 (+ 101us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.090908 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260924 17:33:57.092867 13926 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:33:57.093042 13926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:57.094470 14046 tablet_service.cc:1467] Processing CreateTablet for tablet bed350457913486c959eebbe375db532 (DEFAULT_TABLE table=test-table [id=22db299e4d2d4d06b680dc3a24cc292e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:57.094632 14046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed350457913486c959eebbe375db532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:57.095708 14449 tablet_bootstrap.cc:492] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Bootstrap starting.
I20260924 17:33:57.095768 14349 tablet_service.cc:1467] Processing CreateTablet for tablet bed350457913486c959eebbe375db532 (DEFAULT_TABLE table=test-table [id=22db299e4d2d4d06b680dc3a24cc292e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:57.095881 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed350457913486c959eebbe375db532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:57.096048 14449 tablet_bootstrap.cc:654] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:57.097018 14447 tablet_bootstrap.cc:492] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Bootstrap starting.
I20260924 17:33:57.097097 14207 tablet_service.cc:1467] Processing CreateTablet for tablet bed350457913486c959eebbe375db532 (DEFAULT_TABLE table=test-table [id=22db299e4d2d4d06b680dc3a24cc292e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:57.097213 14207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bed350457913486c959eebbe375db532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:57.097491 14447 tablet_bootstrap.cc:654] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:57.098376 14447 tablet_bootstrap.cc:492] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: No bootstrap required, opened a new log
I20260924 17:33:57.098423 14447 ts_tablet_manager.cc:1397] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:57.098573 14447 raft_consensus.cc:348] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.098690 14447 raft_consensus.cc:374] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:57.098717 14447 raft_consensus.cc:729] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Initialized, Role: FOLLOWER
I20260924 17:33:57.098759 14447 consensus_queue.cc:260] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.098865 14447 ts_tablet_manager.cc:1428] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:57.099018 14445 tablet_bootstrap.cc:492] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Bootstrap starting.
I20260924 17:33:57.099236 14449 tablet_bootstrap.cc:492] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: No bootstrap required, opened a new log
I20260924 17:33:57.099283 14449 ts_tablet_manager.cc:1397] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260924 17:33:57.099417 14445 tablet_bootstrap.cc:654] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:57.099411 14449 raft_consensus.cc:348] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.099483 14449 raft_consensus.cc:374] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:57.099507 14449 raft_consensus.cc:729] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Initialized, Role: FOLLOWER
I20260924 17:33:57.099553 14449 consensus_queue.cc:260] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.099648 14449 ts_tablet_manager.cc:1428] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:57.100723 14445 tablet_bootstrap.cc:492] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: No bootstrap required, opened a new log
I20260924 17:33:57.100793 14445 ts_tablet_manager.cc:1397] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:33:57.100960 14445 raft_consensus.cc:348] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.101032 14445 raft_consensus.cc:374] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:57.101059 14445 raft_consensus.cc:729] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840528a7b6944faeb3dc882867c05892, State: Initialized, Role: FOLLOWER
I20260924 17:33:57.101101 14445 consensus_queue.cc:260] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.101188 14445 ts_tablet_manager.cc:1428] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:33:57.153990 14453 raft_consensus.cc:482] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:57.154109 14453 raft_consensus.cc:504] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.154282 14453 leader_election.cc:288] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805), 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471)
I20260924 17:33:57.154515 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed350457913486c959eebbe375db532" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892" is_pre_election: true
I20260924 17:33:57.154608 14227 raft_consensus.cc:2454] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 0.
I20260924 17:33:57.154570 14371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed350457913486c959eebbe375db532" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" is_pre_election: true
I20260924 17:33:57.154646 14371 raft_consensus.cc:2454] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 0.
I20260924 17:33:57.154758 14015 leader_election.cc:302] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5644065e044b435b92b36e8d5ace80e2, 840528a7b6944faeb3dc882867c05892; no voters:
I20260924 17:33:57.154856 14453 raft_consensus.cc:2781] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:57.154906 14453 raft_consensus.cc:482] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:57.154925 14453 raft_consensus.cc:3037] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:57.155608 14453 raft_consensus.cc:504] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.155747 14453 leader_election.cc:288] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 election: Requested vote from peers 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805), 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471)
I20260924 17:33:57.155911 14371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed350457913486c959eebbe375db532" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67"
I20260924 17:33:57.155910 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bed350457913486c959eebbe375db532" candidate_uuid: "5644065e044b435b92b36e8d5ace80e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892"
I20260924 17:33:57.155974 14371 raft_consensus.cc:3037] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:57.155973 14227 raft_consensus.cc:3037] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:57.156767 14371 raft_consensus.cc:2454] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 1.
I20260924 17:33:57.156767 14227 raft_consensus.cc:2454] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5644065e044b435b92b36e8d5ace80e2 in term 1.
I20260924 17:33:57.156924 14017 leader_election.cc:302] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 5644065e044b435b92b36e8d5ace80e2; no voters:
I20260924 17:33:57.157091 14453 raft_consensus.cc:2781] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:57.157142 14453 raft_consensus.cc:686] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 1 LEADER]: Becoming Leader. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Running, Role: LEADER
I20260924 17:33:57.157186 14453 consensus_queue.cc:237] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.157703 13925 catalog_manager.cc:5495] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1). New cstate: current_term: 1 leader_uuid: "5644065e044b435b92b36e8d5ace80e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } health_report { overall_health: UNKNOWN } } }
I20260924 17:33:57.176221 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.173856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43684 (local address 127.6.37.1:33741)
0924 17:33:57.173938 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.173940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.173948 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:57.173970 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.173971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.173982 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.174050 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:57.174159 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.174658 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.175516 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.175738 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.175823 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.175980 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.176012 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.176061 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.176124 (+ 63us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.176144 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260924 17:33:57.177032 14227 raft_consensus.cc:1261] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Refusing update from remote peer 5644065e044b435b92b36e8d5ace80e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.177031 14371 raft_consensus.cc:1261] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Refusing update from remote peer 5644065e044b435b92b36e8d5ace80e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.177242 14464 consensus_queue.cc:1035] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.177420 14464 consensus_queue.cc:1035] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.180600 13925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:57.180696 13925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:57.181280 13925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Sending DeleteTablet for 3 replicas of tablet bed350457913486c959eebbe375db532
I20260924 17:33:57.181525 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet bed350457913486c959eebbe375db532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:48712
I20260924 17:33:57.181701 14469 tablet_replica.cc:330] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: stopping tablet replica
I20260924 17:33:57.181707 14207 tablet_service.cc:1514] Processing DeleteTablet for tablet bed350457913486c959eebbe375db532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:52044
I20260924 17:33:57.181756 14469 raft_consensus.cc:2229] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:57.181717 13925 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260924 17:33:57.181798 14469 raft_consensus.cc:2258] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.181826 14471 tablet_replica.cc:330] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: stopping tablet replica
W20260924 17:33:57.181849 13925 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:33:57.181896 14471 raft_consensus.cc:2229] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:57.181954 14471 raft_consensus.cc:2258] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.181974 14046 tablet_service.cc:1514] Processing DeleteTablet for tablet bed350457913486c959eebbe375db532 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:43656
I20260924 17:33:57.182049 14470 tablet_replica.cc:330] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: stopping tablet replica
I20260924 17:33:57.182106 14470 raft_consensus.cc:2229] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:57.182169 14470 raft_consensus.cc:2258] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.182284 14471 ts_tablet_manager.cc:1905] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.182680 14470 ts_tablet_manager.cc:1905] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.184092 14471 ts_tablet_manager.cc:1918] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:57.184161 14471 log.cc:1196] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/bed350457913486c959eebbe375db532
I20260924 17:33:57.184330 14470 ts_tablet_manager.cc:1918] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:57.184381 14470 log.cc:1196] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/bed350457913486c959eebbe375db532
I20260924 17:33:57.184422 14471 ts_tablet_manager.cc:1939] T bed350457913486c959eebbe375db532 P 840528a7b6944faeb3dc882867c05892: Deleting consensus metadata
I20260924 17:33:57.184618 14470 ts_tablet_manager.cc:1939] T bed350457913486c959eebbe375db532 P 5644065e044b435b92b36e8d5ace80e2: Deleting consensus metadata
I20260924 17:33:57.184772 13911 catalog_manager.cc:4841] TS 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805): tablet bed350457913486c959eebbe375db532 (table test-table [id=22db299e4d2d4d06b680dc3a24cc292e]) successfully deleted
I20260924 17:33:57.185041 13911 catalog_manager.cc:4841] TS 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741): tablet bed350457913486c959eebbe375db532 (table test-table [id=22db299e4d2d4d06b680dc3a24cc292e]) successfully deleted
I20260924 17:33:57.185267 14469 ts_tablet_manager.cc:1905] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.185395 14207 tablet_service.cc:1467] Processing CreateTablet for tablet 6848e50caad845e4b5e4ed85251016ff (DEFAULT_TABLE table=test-table [id=468fee3791dd4cdb85c42fec481f287a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:57.185496 14207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6848e50caad845e4b5e4ed85251016ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:57.186689 14445 tablet_bootstrap.cc:492] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Bootstrap starting.
I20260924 17:33:57.186798 14469 ts_tablet_manager.cc:1918] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:33:57.186863 14469 log.cc:1196] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/bed350457913486c959eebbe375db532
I20260924 17:33:57.187074 14445 tablet_bootstrap.cc:654] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:57.187116 14469 ts_tablet_manager.cc:1939] T bed350457913486c959eebbe375db532 P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting consensus metadata
I20260924 17:33:57.187311 14349 tablet_service.cc:1467] Processing CreateTablet for tablet 6848e50caad845e4b5e4ed85251016ff (DEFAULT_TABLE table=test-table [id=468fee3791dd4cdb85c42fec481f287a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:57.187413 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6848e50caad845e4b5e4ed85251016ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:57.188395 14447 tablet_bootstrap.cc:492] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Bootstrap starting.
I20260924 17:33:57.188490 14046 tablet_service.cc:1467] Processing CreateTablet for tablet 6848e50caad845e4b5e4ed85251016ff (DEFAULT_TABLE table=test-table [id=468fee3791dd4cdb85c42fec481f287a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:33:57.188619 14046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6848e50caad845e4b5e4ed85251016ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:33:57.188704 14447 tablet_bootstrap.cc:654] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:57.189304 14447 tablet_bootstrap.cc:492] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: No bootstrap required, opened a new log
I20260924 17:33:57.189374 14447 ts_tablet_manager.cc:1397] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:57.189540 14447 raft_consensus.cc:348] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.189632 14447 raft_consensus.cc:374] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:57.189659 14447 raft_consensus.cc:729] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Initialized, Role: FOLLOWER
I20260924 17:33:57.189710 14447 consensus_queue.cc:260] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.189833 14447 ts_tablet_manager.cc:1428] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:57.189954 14449 tablet_bootstrap.cc:492] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: Bootstrap starting.
I20260924 17:33:57.190259 14449 tablet_bootstrap.cc:654] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: Neither blocks nor log segments found. Creating new log.
I20260924 17:33:57.190816 14449 tablet_bootstrap.cc:492] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: No bootstrap required, opened a new log
I20260924 17:33:57.190894 14449 ts_tablet_manager.cc:1397] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:33:57.191015 14449 raft_consensus.cc:348] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.191079 14449 raft_consensus.cc:374] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:57.191094 14449 raft_consensus.cc:729] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5644065e044b435b92b36e8d5ace80e2, State: Initialized, Role: FOLLOWER
I20260924 17:33:57.191164 14449 consensus_queue.cc:260] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.191265 14449 ts_tablet_manager.cc:1428] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:57.191459 13913 catalog_manager.cc:4841] TS 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471): tablet bed350457913486c959eebbe375db532 (table test-table [id=22db299e4d2d4d06b680dc3a24cc292e]) successfully deleted
I20260924 17:33:57.191681 14445 tablet_bootstrap.cc:492] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: No bootstrap required, opened a new log
I20260924 17:33:57.191733 14445 ts_tablet_manager.cc:1397] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260924 17:33:57.191862 14445 raft_consensus.cc:348] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.191937 14445 raft_consensus.cc:374] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:33:57.191957 14445 raft_consensus.cc:729] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 840528a7b6944faeb3dc882867c05892, State: Initialized, Role: FOLLOWER
I20260924 17:33:57.192027 14445 consensus_queue.cc:260] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.192129 14445 ts_tablet_manager.cc:1428] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:57.393994 14452 raft_consensus.cc:482] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:33:57.394096 14452 raft_consensus.cc:504] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.394296 14452 leader_election.cc:288] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741), 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:57.394569 14084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6848e50caad845e4b5e4ed85251016ff" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5644065e044b435b92b36e8d5ace80e2" is_pre_election: true
I20260924 17:33:57.394660 14084 raft_consensus.cc:2454] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 0.
I20260924 17:33:57.394590 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6848e50caad845e4b5e4ed85251016ff" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892" is_pre_election: true
I20260924 17:33:57.394730 14227 raft_consensus.cc:2454] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 0.
I20260924 17:33:57.394905 14301 leader_election.cc:302] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 5644065e044b435b92b36e8d5ace80e2; no voters:
I20260924 17:33:57.395035 14452 raft_consensus.cc:2781] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:33:57.395102 14452 raft_consensus.cc:482] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:33:57.395135 14452 raft_consensus.cc:3037] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:57.395839 14452 raft_consensus.cc:504] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.395978 14452 leader_election.cc:288] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 election: Requested vote from peers 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741), 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805)
I20260924 17:33:57.396183 14084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6848e50caad845e4b5e4ed85251016ff" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5644065e044b435b92b36e8d5ace80e2"
I20260924 17:33:57.396209 14227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6848e50caad845e4b5e4ed85251016ff" candidate_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "840528a7b6944faeb3dc882867c05892"
I20260924 17:33:57.396287 14084 raft_consensus.cc:3037] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:57.396286 14227 raft_consensus.cc:3037] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:33:57.396898 14084 raft_consensus.cc:2454] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 1.
I20260924 17:33:57.396924 14227 raft_consensus.cc:2454] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 445c8e0f2537479c9f5a3ef7afb1ae67 in term 1.
I20260924 17:33:57.397083 14301 leader_election.cc:302] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 445c8e0f2537479c9f5a3ef7afb1ae67, 5644065e044b435b92b36e8d5ace80e2; no voters:
I20260924 17:33:57.397193 14452 raft_consensus.cc:2781] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:33:57.397251 14452 raft_consensus.cc:686] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 LEADER]: Becoming Leader. State: Replica: 445c8e0f2537479c9f5a3ef7afb1ae67, State: Running, Role: LEADER
I20260924 17:33:57.397323 14452 consensus_queue.cc:237] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } }
I20260924 17:33:57.397910 13925 catalog_manager.cc:5495] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3). New cstate: current_term: 1 leader_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "445c8e0f2537479c9f5a3ef7afb1ae67" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 33471 } health_report { overall_health: HEALTHY } } }
I20260924 17:33:57.419234 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.417154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.6.37.3:33471)
0924 17:33:57.417204 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.417206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.417214 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:33:57.417256 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.417257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.417265 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.417329 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:57.417425 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.417895 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.418573 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.418764 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.418837 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.418988 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.419015 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.419056 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.419126 (+ 70us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.419142 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260924 17:33:57.424257 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.421652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:50935 (local address 127.6.37.3:33471)
0924 17:33:57.421691 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:33:57.421693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:33:57.421706 (+ 13us) server_negotiation.cc:407] Connection header received
0924 17:33:57.421790 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:33:57.421791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:33:57.421844 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:33:57.421913 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:33:57.422018 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.422505 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.423404 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.423599 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.423679 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.424016 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.424053 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.424089 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0924 17:33:57.424175 (+ 86us) server_negotiation.cc:299] Negotiation successful
0924 17:33:57.424192 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:33:57.424261 14505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.421586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:33471 (local address 127.6.37.3:50935)
0924 17:33:57.421661 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:57.421674 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:33:57.421722 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:33:57.421915 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:33:57.421916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:33:57.421917 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0924 17:33:57.421962 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.421964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.422606 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.422607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.423280 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:33:57.423282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:33:57.423688 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:33:57.423689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:33:57.423821 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:33:57.423830 (+ 9us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0924 17:33:57.424110 (+ 280us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0924 17:33:57.424112 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:33:57.424158 (+ 46us) client_negotiation.cc:240] Negotiation successful
0924 17:33:57.424199 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":3}
I20260924 17:33:57.426365 14227 raft_consensus.cc:1261] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Refusing update from remote peer 445c8e0f2537479c9f5a3ef7afb1ae67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.426391 14084 raft_consensus.cc:1261] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Refusing update from remote peer 445c8e0f2537479c9f5a3ef7afb1ae67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:33:57.426620 14500 consensus_queue.cc:1035] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5644065e044b435b92b36e8d5ace80e2" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.426723 14452 consensus_queue.cc:1035] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "840528a7b6944faeb3dc882867c05892" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 36805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:33:57.436825 13925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:57.436924 13925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49062:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:33:57.437562 13925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32b4a3357b4546a8a4368569a360669c: Sending DeleteTablet for 3 replicas of tablet 6848e50caad845e4b5e4ed85251016ff
I20260924 17:33:57.437788 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet 6848e50caad845e4b5e4ed85251016ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:48712
I20260924 17:33:57.437819 14046 tablet_service.cc:1514] Processing DeleteTablet for tablet 6848e50caad845e4b5e4ed85251016ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:43656
I20260924 17:33:57.437820 14207 tablet_service.cc:1514] Processing DeleteTablet for tablet 6848e50caad845e4b5e4ed85251016ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:33:57 UTC) from {username='oryx', principal='oryx/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:52044
I20260924 17:33:57.437876 14469 tablet_replica.cc:330] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: stopping tablet replica
I20260924 17:33:57.437919 14469 raft_consensus.cc:2229] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:33:57.437929 14470 tablet_replica.cc:330] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: stopping tablet replica
I20260924 17:33:57.437978 14470 raft_consensus.cc:2229] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:57.438005 14470 raft_consensus.cc:2258] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.438006 14469 raft_consensus.cc:2258] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.438081 14471 tablet_replica.cc:330] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: stopping tablet replica
I20260924 17:33:57.438144 14471 raft_consensus.cc:2229] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:33:57.438189 14471 raft_consensus.cc:2258] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:33:57.438535 14471 ts_tablet_manager.cc:1905] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.438603 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 13998
I20260924 17:33:57.438614 14470 ts_tablet_manager.cc:1905] T 6848e50caad845e4b5e4ed85251016ff P 5644065e044b435b92b36e8d5ace80e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.440481 14471 ts_tablet_manager.cc:1918] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:57.440538 14471 log.cc:1196] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/6848e50caad845e4b5e4ed85251016ff
I20260924 17:33:57.440753 14471 ts_tablet_manager.cc:1939] T 6848e50caad845e4b5e4ed85251016ff P 840528a7b6944faeb3dc882867c05892: Deleting consensus metadata
I20260924 17:33:57.440914 14469 ts_tablet_manager.cc:1905] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:33:57.441205 13911 catalog_manager.cc:4841] TS 840528a7b6944faeb3dc882867c05892 (127.6.37.2:36805): tablet 6848e50caad845e4b5e4ed85251016ff (table test-table [id=468fee3791dd4cdb85c42fec481f287a]) successfully deleted
I20260924 17:33:57.442643 14469 ts_tablet_manager.cc:1918] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260924 17:33:57.442706 14469 log.cc:1196] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/6848e50caad845e4b5e4ed85251016ff
I20260924 17:33:57.442947 14469 ts_tablet_manager.cc:1939] T 6848e50caad845e4b5e4ed85251016ff P 445c8e0f2537479c9f5a3ef7afb1ae67: Deleting consensus metadata
I20260924 17:33:57.443411 13913 catalog_manager.cc:4841] TS 445c8e0f2537479c9f5a3ef7afb1ae67 (127.6.37.3:33471): tablet 6848e50caad845e4b5e4ed85251016ff (table test-table [id=468fee3791dd4cdb85c42fec481f287a]) successfully deleted
W20260924 17:33:57.446812 13911 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:33741 (error 108)
I20260924 17:33:57.447136 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 14140
I20260924 17:33:57.450618 14538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:33:57.450403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:33741 (local address 127.0.0.1:40244)
0924 17:33:57.450516 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0924 17:33:57.450568 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:33741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
W20260924 17:33:57.454643 13911 catalog_manager.cc:4584] TS 5644065e044b435b92b36e8d5ace80e2 (127.6.37.1:33741): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6848e50caad845e4b5e4ed85251016ff: Network error: Client connection negotiation failed: client connection to 127.6.37.1:33741: connect: Connection refused (error 111)
I20260924 17:33:57.455199 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 14284
I20260924 17:33:57.461441 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 13894
2026-09-24T17:33:57Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2950 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[14541](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[14541](info): set up 2 sockets
Sep 24 17:33:57 dist-test-slave-gcz9 krb5kdc[14541](info): commencing operation
krb5kdc: starting...
W20260924 17:33:58.505407 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:58 dist-test-slave-gcz9 krb5kdc[14541](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:58.622233 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:43095
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:39099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:43095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:58.701831 14554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:58.702041 14554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:58.702064 14554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:58.703166 14554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:58.703198 14554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:58.703212 14554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:58.703225 14554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:58.703238 14554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:58.704752 14554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:39099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:43095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:43095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:58.704941 14554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:58.705106 14554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:58.709728 14559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:58.709803 14554 server_base.cc:1034] running on GCE node
W20260924 17:33:58.709780 14560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:58.709735 14562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:58.710181 14554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:58.710486 14554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:58.711654 14554 hybrid_clock.cc:648] HybridClock initialized: now 1790271238711635 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-24T17:33:58Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1257 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:33:58 dist-test-slave-gcz9 krb5kdc[14567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:33:58 dist-test-slave-gcz9 krb5kdc[14567](info): set up 2 sockets
Sep 24 17:33:58 dist-test-slave-gcz9 krb5kdc[14567](info): commencing operation
krb5kdc: starting...
W20260924 17:33:59.769328 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:33:59 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:33:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:33:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:33:59.886065 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42733
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:33:59.967139 14580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:33:59.967389 14580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:33:59.967427 14580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:33:59.968614 14580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:33:59.968681 14580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:33:59.968708 14580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:33:59.968741 14580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:33:59.968763 14580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:33:59.970271 14580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:33:59.970543 14580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:33:59.970767 14580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:33:59.975759 14588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:33:59.975801 14586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:59.975839 14580 server_base.cc:1034] running on GCE node
W20260924 17:33:59.975759 14585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:33:59.976234 14580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:33:59.976590 14580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:33:59.977766 14580 hybrid_clock.cc:648] HybridClock initialized: now 1790271239977747 us; error 33 us; skew 500 ppm
Sep 24 17:33:59 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271239, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:33:59.980338 14580 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:33:59.980762 14580 webserver.cc:460] Webserver started at http://127.6.37.62:39761/ using document root <none> and password file <none>
I20260924 17:33:59.980993 14580 fs_manager.cc:359] Metadata directory not provided
I20260924 17:33:59.981062 14580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:33:59.981213 14580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:33:59.982317 14580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "a7fb61e65bf14484ba5a31de94d09aab"
format_stamp: "Formatted at 2026-09-24 17:33:59 on dist-test-slave-gcz9"
server_key: "442b5db72e88be91c94679cabb41faa3"
server_key_iv: "80925af928328b40acb26fcdcd322edc"
server_key_version: "encryptionkey@0"
I20260924 17:33:59.982681 14580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "a7fb61e65bf14484ba5a31de94d09aab"
format_stamp: "Formatted at 2026-09-24 17:33:59 on dist-test-slave-gcz9"
server_key: "442b5db72e88be91c94679cabb41faa3"
server_key_iv: "80925af928328b40acb26fcdcd322edc"
server_key_version: "encryptionkey@0"
I20260924 17:33:59.984043 14580 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:33:59.984764 14595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:33:59.984941 14580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:33:59.985041 14580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "a7fb61e65bf14484ba5a31de94d09aab"
format_stamp: "Formatted at 2026-09-24 17:33:59 on dist-test-slave-gcz9"
server_key: "442b5db72e88be91c94679cabb41faa3"
server_key_iv: "80925af928328b40acb26fcdcd322edc"
server_key_version: "encryptionkey@0"
I20260924 17:33:59.985129 14580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:33:59.998526 14580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:00.000283 14580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:00.000443 14580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:00.004485 14580 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:42733
I20260924 17:34:00.004521 14647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:42733 every 8 connection(s)
I20260924 17:34:00.004915 14580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:34:00.005751 14648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:00.008643 14648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Bootstrap starting.
I20260924 17:34:00.009608 14648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:00.010107 14648 log.cc:824] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:00.010381 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 14580
I20260924 17:34:00.010499 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:34:00.010721 6292 external_mini_cluster.cc:1428] Setting key 6e01779d04a294bbe36c53e0916bd089
I20260924 17:34:00.011073 14648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: No bootstrap required, opened a new log
I20260924 17:34:00.014114 14648 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.014336 14648 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:00.014380 14648 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7fb61e65bf14484ba5a31de94d09aab, State: Initialized, Role: FOLLOWER
I20260924 17:34:00.014555 14648 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.014664 14648 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:34:00.014714 14648 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:34:00.014762 14648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:00.015641 14648 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.015784 14648 leader_election.cc:302] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7fb61e65bf14484ba5a31de94d09aab; no voters:
I20260924 17:34:00.015980 14648 leader_election.cc:288] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:34:00.016094 14653 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:34:00.016270 14648 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:34:00.016304 14653 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 LEADER]: Becoming Leader. State: Replica: a7fb61e65bf14484ba5a31de94d09aab, State: Running, Role: LEADER
I20260924 17:34:00.016502 14653 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.016949 14654 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7fb61e65bf14484ba5a31de94d09aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } } }
I20260924 17:34:00.017056 14654 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:00.017234 14655 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7fb61e65bf14484ba5a31de94d09aab. Latest consensus state: current_term: 1 leader_uuid: "a7fb61e65bf14484ba5a31de94d09aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } } }
I20260924 17:34:00.017313 14655 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: This master's current role is: LEADER
W20260924 17:34:00.018325 14668 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:34:00.018433 14668 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:34:00.018602 14662 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271239, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:00.021194 14662 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:34:00.023058 14662 catalog_manager.cc:1347] Generated new cluster ID: 3894e2d33ac4471e9ebe5fcd13774baa
I20260924 17:34:00.023113 14662 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:34:00.025125 14652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.011358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52992 (local address 127.6.37.62:42733)
0924 17:34:00.011628 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.011639 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.011674 (+ 35us) server_negotiation.cc:407] Connection header received
0924 17:34:00.012941 (+ 1267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.012953 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.013027 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.013223 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.014063 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.015975 (+ 1912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.017160 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.017922 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.018414 (+ 492us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.021040 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:00.021045 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:00.021045 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:00.021057 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:00.023325 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.023791 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.023794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.023794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.023898 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.024135 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.024136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.024136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.024436 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:00.024574 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:00.024775 (+ 201us) server_negotiation.cc:299] Negotiation successful
0924 17:34:00.024914 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":90,"threads_started":1}
I20260924 17:34:00.033085 14662 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:34:00.033608 14662 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:34:00.039772 14662 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Generated new TSK 0
I20260924 17:34:00.039966 14662 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:34:00.070842 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42733
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:00.152689 14675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:00.152930 14675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:00.152968 14675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:00.154155 14675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:00.154223 14675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:00.154269 14675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:34:00.155830 14675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:00.156095 14675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:00.156329 14675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:00.161286 14681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.161310 14680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.161353 14675 server_base.cc:1034] running on GCE node
W20260924 17:34:00.161278 14683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.161855 14675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:00.162119 14675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:00.163262 14675 hybrid_clock.cc:648] HybridClock initialized: now 1790271240163235 us; error 38 us; skew 500 ppm
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:00.165828 14675 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:34:00.166263 14675 webserver.cc:460] Webserver started at http://127.6.37.1:45459/ using document root <none> and password file <none>
I20260924 17:34:00.166491 14675 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:00.166560 14675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:00.166712 14675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:00.167832 14675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "1b1fb07b143f4a7898f5fa836eeaaf37"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "413a546e41347cc7df4300de44401a91"
server_key_iv: "6877e3cf170a2df18db0cd916a2cd8b9"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.168210 14675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "1b1fb07b143f4a7898f5fa836eeaaf37"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "413a546e41347cc7df4300de44401a91"
server_key_iv: "6877e3cf170a2df18db0cd916a2cd8b9"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.169586 14675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:34:00.170406 14690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.170599 14675 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:00.170698 14675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "1b1fb07b143f4a7898f5fa836eeaaf37"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "413a546e41347cc7df4300de44401a91"
server_key_iv: "6877e3cf170a2df18db0cd916a2cd8b9"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.170785 14675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:00.187206 14675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:00.189414 14675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:00.189589 14675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:00.189834 14675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:00.190155 14675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:00.190212 14675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.190253 14675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:00.190281 14675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.196281 14675 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:46285
I20260924 17:34:00.196338 14805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:46285 every 8 connection(s)
I20260924 17:34:00.196704 14675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:00.206317 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 14675
I20260924 17:34:00.206444 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:34:00.206676 6292 external_mini_cluster.cc:1428] Setting key 6b107e446b1e56edf5692af46e6a30bb
I20260924 17:34:00.206854 14652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.197500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:40275 (local address 127.6.37.62:42733)
0924 17:34:00.197565 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.197567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.197797 (+ 230us) server_negotiation.cc:407] Connection header received
0924 17:34:00.198402 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.198403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.198417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.198472 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.199496 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.200026 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.201077 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.201298 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.201389 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.203718 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:00.203720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:00.203721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:00.203729 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:00.205020 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.205743 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.205744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.205744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.205822 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.206130 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.206131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.206131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.206257 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:00.206334 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:00.206664 (+ 330us) server_negotiation.cc:299] Negotiation successful
0924 17:34:00.206763 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:34:00.207129 14808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.197467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:40275)
0924 17:34:00.197656 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:00.197704 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:00.198286 (+ 582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:00.198545 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:00.198550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:00.199171 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:00.199381 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.199388 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.200144 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.200145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.200974 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.200976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.201404 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.201405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.201541 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.202148 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:00.202157 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:00.203610 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:00.205132 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:00.205140 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:00.205142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:00.205407 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:00.205932 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:00.205933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:00.205933 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:00.206048 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:00.206324 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:00.206331 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:00.206507 (+ 176us) client_negotiation.cc:769] Sending connection context
0924 17:34:00.206641 (+ 134us) client_negotiation.cc:240] Negotiation successful
0924 17:34:00.206812 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":88,"threads_started":1}
I20260924 17:34:00.207608 14806 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42733
I20260924 17:34:00.207731 14806 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:00.207917 14806 heartbeater.cc:511] Master 127.6.37.62:42733 requested a full tablet report, sending...
I20260924 17:34:00.208504 14612 ts_manager.cc:194] Registered new tserver with Master: 1b1fb07b143f4a7898f5fa836eeaaf37 (127.6.37.1:46285)
I20260924 17:34:00.209453 14612 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:40275
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:34:00.233613 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42733
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:00.315201 14811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:00.315423 14811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:00.315447 14811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:00.316686 14811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:00.316726 14811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:00.316752 14811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:34:00.318296 14811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:00.318495 14811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:00.318696 14811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:00.323768 14817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.323773 14816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.323829 14819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.324043 14811 server_base.cc:1034] running on GCE node
I20260924 17:34:00.324272 14811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:00.324518 14811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:00.325682 14811 hybrid_clock.cc:648] HybridClock initialized: now 1790271240325669 us; error 43 us; skew 500 ppm
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:00.328254 14811 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:34:00.328701 14811 webserver.cc:460] Webserver started at http://127.6.37.2:39331/ using document root <none> and password file <none>
I20260924 17:34:00.328928 14811 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:00.328974 14811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:00.329128 14811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:00.330242 14811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "d96693e53c214d81b76c6c3c371b53a1"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "d6032232a2e15060326c57a53b2ab95f"
server_key_iv: "bdc83b04578ab13d89dfc05ea79874f5"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.330605 14811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "d96693e53c214d81b76c6c3c371b53a1"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "d6032232a2e15060326c57a53b2ab95f"
server_key_iv: "bdc83b04578ab13d89dfc05ea79874f5"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.332175 14811 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:34:00.332916 14826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.333099 14811 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:34:00.333195 14811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "d96693e53c214d81b76c6c3c371b53a1"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "d6032232a2e15060326c57a53b2ab95f"
server_key_iv: "bdc83b04578ab13d89dfc05ea79874f5"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.333272 14811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:00.344236 14811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:00.346047 14811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:00.346212 14811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:00.346457 14811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:00.346772 14811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:00.346824 14811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.346856 14811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:00.346963 14811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.352501 14811 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:39879
I20260924 17:34:00.352589 14940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:39879 every 8 connection(s)
I20260924 17:34:00.352914 14811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:34:00.358475 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 14811
I20260924 17:34:00.358620 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:34:00.358821 6292 external_mini_cluster.cc:1428] Setting key fc29081888cb7a4a18467d8f11009375
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:00.362599 14652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.353640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:52185 (local address 127.6.37.62:42733)
0924 17:34:00.353683 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.353685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.353908 (+ 223us) server_negotiation.cc:407] Connection header received
0924 17:34:00.354426 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.354427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.354467 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.354527 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.355561 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.356072 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.357027 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.357201 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.357250 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.359720 (+ 2470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:00.359721 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:00.359722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:00.359730 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:00.361167 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.361605 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.361606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.361607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.361672 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.361926 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.361927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.361927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.362048 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:00.362142 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:00.362419 (+ 277us) server_negotiation.cc:299] Negotiation successful
0924 17:34:00.362508 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260924 17:34:00.362954 14943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.353613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:52185)
0924 17:34:00.353791 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:00.353833 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:00.354333 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:00.354612 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:00.354616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:00.355256 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:00.355470 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.355475 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.356155 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.356156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.356952 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.356954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.357271 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.357272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.357375 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.357921 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:00.357930 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:00.359627 (+ 1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:00.361286 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:00.361294 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:00.361296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:00.361525 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:00.361738 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:00.361739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:00.361739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:00.361856 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:00.362134 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:00.362141 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:00.362284 (+ 143us) client_negotiation.cc:769] Sending connection context
0924 17:34:00.362396 (+ 112us) client_negotiation.cc:240] Negotiation successful
0924 17:34:00.362560 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260924 17:34:00.363575 14941 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42733
I20260924 17:34:00.363686 14941 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:00.363864 14941 heartbeater.cc:511] Master 127.6.37.62:42733 requested a full tablet report, sending...
I20260924 17:34:00.364283 14612 ts_manager.cc:194] Registered new tserver with Master: d96693e53c214d81b76c6c3c371b53a1 (127.6.37.2:39879)
I20260924 17:34:00.364835 14612 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:52185
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:34:00.386149 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42733
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:00.468075 14946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:00.468281 14946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:00.468304 14946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:00.469502 14946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:00.469559 14946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:00.469587 14946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:34:00.471098 14946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:00.471357 14946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:00.471609 14946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:00.476869 14954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.476941 14951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.476917 14952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.476897 14946 server_base.cc:1034] running on GCE node
I20260924 17:34:00.477226 14946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:00.477465 14946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:00.478628 14946 hybrid_clock.cc:648] HybridClock initialized: now 1790271240478602 us; error 34 us; skew 500 ppm
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:00.481240 14946 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:34:00.481643 14946 webserver.cc:460] Webserver started at http://127.6.37.3:43253/ using document root <none> and password file <none>
I20260924 17:34:00.481850 14946 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:00.481892 14946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:00.481981 14946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:00.483083 14946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "012941adbc6741cea830fcf6a182e7b6"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "cdb31ae70866abdf41edbf7d7fcda7b4"
server_key_iv: "7ec8816beb0474849ec396fb5fedf2cc"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.483390 14946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "012941adbc6741cea830fcf6a182e7b6"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "cdb31ae70866abdf41edbf7d7fcda7b4"
server_key_iv: "7ec8816beb0474849ec396fb5fedf2cc"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.484639 14946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:00.485432 14961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.485613 14946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:34:00.485709 14946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "012941adbc6741cea830fcf6a182e7b6"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "cdb31ae70866abdf41edbf7d7fcda7b4"
server_key_iv: "7ec8816beb0474849ec396fb5fedf2cc"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.485785 14946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:00.502907 14946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:00.504907 14946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:00.505084 14946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:00.505363 14946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:00.505723 14946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:00.505782 14946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.505820 14946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:00.505847 14946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.512050 14946 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:40373
I20260924 17:34:00.512089 15077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:40373 every 8 connection(s)
I20260924 17:34:00.512434 14946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:00.521409 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 14946
I20260924 17:34:00.521533 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:34:00.521776 6292 external_mini_cluster.cc:1428] Setting key e79930cd224c81f56bc7955755e78d9e
I20260924 17:34:00.522843 14652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.513129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:52423 (local address 127.6.37.62:42733)
0924 17:34:00.513190 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.513192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.513434 (+ 242us) server_negotiation.cc:407] Connection header received
0924 17:34:00.513987 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.513988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.514009 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.514061 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.515120 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.515630 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.516875 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.517159 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.517225 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.519903 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:00.519904 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:00.519904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:00.519911 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:00.521193 (+ 1282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.521726 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.521727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.521728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.521777 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:00.522081 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:00.522082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:00.522083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:00.522227 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:00.522294 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:00.522653 (+ 359us) server_negotiation.cc:299] Negotiation successful
0924 17:34:00.522740 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:34:00.522980 15080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.513103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:52423)
0924 17:34:00.513266 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:00.513331 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:00.513896 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:00.514141 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:00.514145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:00.514716 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:00.515040 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.515046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.515724 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.515725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.516802 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.516805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.517270 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.517287 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.517424 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.518124 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:00.518134 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:00.519810 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:00.521274 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:00.521281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:00.521283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:00.521644 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:00.521851 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:00.521852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:00.521852 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:00.521999 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:00.522347 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:00.522353 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:00.522526 (+ 173us) client_negotiation.cc:769] Sending connection context
0924 17:34:00.522615 (+ 89us) client_negotiation.cc:240] Negotiation successful
0924 17:34:00.522739 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":95,"threads_started":1}
I20260924 17:34:00.523518 15078 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42733
I20260924 17:34:00.523638 15078 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:00.523826 15078 heartbeater.cc:511] Master 127.6.37.62:42733 requested a full tablet report, sending...
I20260924 17:34:00.524232 14612 ts_manager.cc:194] Registered new tserver with Master: 012941adbc6741cea830fcf6a182e7b6 (127.6.37.3:40373)
I20260924 17:34:00.524618 14612 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:52423
I20260924 17:34:00.533948 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab.
Entry for principal oryx/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab.
WARNING: no policy specified for oryx/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab.
Entry for principal oryx/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab.
WARNING: no policy specified for oryx/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab.
Entry for principal oryx/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab.
I20260924 17:34:00.610086 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 14675
I20260924 17:34:00.615343 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 14811
I20260924 17:34:00.620085 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 14946
I20260924 17:34:00.624402 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 14580
I20260924 17:34:00.629542 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42733
--webserver_interface=127.6.37.62
--webserver_port=39761
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42733
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:00.709976 15087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:00.710232 15087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:00.710269 15087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:00.711454 15087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:34:00.711530 15087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:00.711555 15087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:00.711583 15087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:34:00.711615 15087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:34:00.713083 15087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42733
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=39761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:00.713358 15087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:00.713593 15087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:00.718631 15092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.718602 15095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.718612 15093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.718940 15087 server_base.cc:1034] running on GCE node
I20260924 17:34:00.719269 15087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:00.719594 15087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:00.720747 15087 hybrid_clock.cc:648] HybridClock initialized: now 1790271240720725 us; error 39 us; skew 500 ppm
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:00.723448 15087 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:34:00.723960 15087 webserver.cc:460] Webserver started at http://127.6.37.62:39761/ using document root <none> and password file <none>
I20260924 17:34:00.724205 15087 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:00.724292 15087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:00.725725 15087 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:00.726516 15103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.726854 15087 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:00.727018 15087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "a7fb61e65bf14484ba5a31de94d09aab"
format_stamp: "Formatted at 2026-09-24 17:33:59 on dist-test-slave-gcz9"
server_key: "442b5db72e88be91c94679cabb41faa3"
server_key_iv: "80925af928328b40acb26fcdcd322edc"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.727392 15087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:00.740412 15087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:00.742472 15087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:00.742650 15087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:00.746840 15087 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:42733
I20260924 17:34:00.746945 15156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:42733 every 8 connection(s)
I20260924 17:34:00.747371 15087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:34:00.748944 15157 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:34:00.749637 15157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Bootstrap starting.
I20260924 17:34:00.754334 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15087
I20260924 17:34:00.754698 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:46285
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:42733
--webserver_port=45459
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:34:00.758504 15157 log.cc:824] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:00.760295 15157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:34:00.760589 15157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Bootstrap complete.
I20260924 17:34:00.763006 15157 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.763235 15157 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7fb61e65bf14484ba5a31de94d09aab, State: Initialized, Role: FOLLOWER
I20260924 17:34:00.763407 15157 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.763479 15157 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:34:00.763541 15157 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:34:00.763589 15157 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 1 FOLLOWER]: Advancing to term 2
I20260924 17:34:00.764583 15157 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.764669 15157 leader_election.cc:302] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7fb61e65bf14484ba5a31de94d09aab; no voters:
I20260924 17:34:00.764863 15157 leader_election.cc:288] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 17:34:00.764925 15161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 2 FOLLOWER]: Leader election won for term 2
I20260924 17:34:00.765066 15161 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [term 2 LEADER]: Becoming Leader. State: Replica: a7fb61e65bf14484ba5a31de94d09aab, State: Running, Role: LEADER
I20260924 17:34:00.765146 15157 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:34:00.765161 15161 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } }
I20260924 17:34:00.765396 15161 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7fb61e65bf14484ba5a31de94d09aab. Latest consensus state: current_term: 2 leader_uuid: "a7fb61e65bf14484ba5a31de94d09aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } } }
I20260924 17:34:00.765483 15161 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:00.765400 15162 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a7fb61e65bf14484ba5a31de94d09aab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7fb61e65bf14484ba5a31de94d09aab" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42733 } } }
I20260924 17:34:00.765676 15162 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:00.765763 15165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:34:00.766232 15165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:34:00.766355 15165 catalog_manager.cc:1259] Loaded cluster ID: 3894e2d33ac4471e9ebe5fcd13774baa
I20260924 17:34:00.766389 15165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:34:00.767675 15165 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:34:00.767863 15165 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a7fb61e65bf14484ba5a31de94d09aab: Loaded TSK: 0
I20260924 17:34:00.768076 15165 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 17:34:00.839663 15159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:00.839912 15159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:00.839955 15159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:00.841150 15159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:00.841190 15159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:00.841216 15159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:34:00.842651 15159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.1.keytab
--principal=oryx/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:46285
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=45459
--tserver_master_addrs=127.6.37.62:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:00.842906 15159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:00.843154 15159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:00.849221 15184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.849305 15159 server_base.cc:1034] running on GCE node
W20260924 17:34:00.849298 15183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:00.849443 15186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:00.849666 15159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:00.849987 15159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:00.851163 15159 hybrid_clock.cc:648] HybridClock initialized: now 1790271240851138 us; error 38 us; skew 500 ppm
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271240, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:00.854074 15159 init.cc:377] Logged in from keytab as oryx/127.6.37.1@KRBTEST.COM (short username oryx)
I20260924 17:34:00.854548 15159 webserver.cc:460] Webserver started at http://127.6.37.1:45459/ using document root <none> and password file <none>
I20260924 17:34:00.854786 15159 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:00.854874 15159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:00.856335 15159 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:34:00.856989 15193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.857167 15159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:34:00.857280 15159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "1b1fb07b143f4a7898f5fa836eeaaf37"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "413a546e41347cc7df4300de44401a91"
server_key_iv: "6877e3cf170a2df18db0cd916a2cd8b9"
server_key_version: "encryptionkey@0"
I20260924 17:34:00.857635 15159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:00.882467 15159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:00.884899 15159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:00.885077 15159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:00.885329 15159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:00.885691 15159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:00.885748 15159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.885790 15159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:00.885818 15159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:00.892947 15159 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:46285
I20260924 17:34:00.893003 15307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:46285 every 8 connection(s)
I20260924 17:34:00.893384 15159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:34:00.900233 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15159
I20260924 17:34:00.900554 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:39879
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:42733
--webserver_port=39331
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:00.902406 15310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.894131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:37573)
0924 17:34:00.894333 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:00.894406 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:00.894978 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:00.895454 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:00.895458 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:00.896055 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:00.896257 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.896262 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.897434 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.897436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.898239 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.898242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.898861 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.898863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.899022 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.899516 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:00.899525 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:00.902257 (+ 2732us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":111,"threads_started":1}
W20260924 17:34:00.902671 15308 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:42733 (0 consecutive failures): Not authorized: Failed to ping master at 127.6.37.62:42733: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
W20260924 17:34:00.903012 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:00.894259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:37573 (local address 127.6.37.62:42733)
0924 17:34:00.894466 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.894474 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.894534 (+ 60us) server_negotiation.cc:407] Connection header received
0924 17:34:00.895203 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.895208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.895251 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.895411 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.896390 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.897321 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.898337 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.898762 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.898906 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.902471 (+ 3565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:37573: BlockingRecv error: recv got EOF from 127.6.37.1:37573 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:00.907717 15310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.902981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:38975)
0924 17:34:00.903042 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:00.903052 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:00.903168 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:00.903351 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:00.903352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:00.903463 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:00.903509 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.903511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.904475 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.904476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.904995 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.904997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.905544 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.905545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.905594 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.906025 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:00.906029 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:00.907671 (+ 1642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260924 17:34:00.907980 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:00.903018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:38975 (local address 127.6.37.62:42733)
0924 17:34:00.903188 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.903190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.903201 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:34:00.903227 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.903228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.903242 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.903336 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.903591 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.904380 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.905086 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.905455 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.905550 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.907888 (+ 2338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:38975: BlockingRecv error: recv got EOF from 127.6.37.1:38975 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:00 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:00.912691 15310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:00.907976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:48569)
0924 17:34:00.908090 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:00.908100 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:00.908143 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:00.908297 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:00.908298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:00.908400 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:00.908425 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.908426 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.909341 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.909342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.909819 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:00.909820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.910335 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.910335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:00.910372 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.910816 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:00.910820 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:00.912648 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":97}
W20260924 17:34:00.912817 15308 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:34:00.912957 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:00.908112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:48569 (local address 127.6.37.62:42733)
0924 17:34:00.908151 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:00.908154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:00.908166 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:34:00.908193 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:00.908194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:00.908207 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:00.908296 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:00.908503 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.909242 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.909904 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:00.910222 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:00.910328 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:00.912761 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:48569: BlockingRecv error: recv got EOF from 127.6.37.1:48569 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260924 17:34:00.995858 15312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:00.996071 15312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:00.996111 15312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:00.997305 15312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:00.997373 15312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:00.997419 15312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:34:00.998955 15312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.2.keytab
--principal=oryx/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:39879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=39331
--tserver_master_addrs=127.6.37.62:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:00.999210 15312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:00.999434 15312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:01.004478 15319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:01.004456 15320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:01.004742 15312 server_base.cc:1034] running on GCE node
W20260924 17:34:01.004756 15322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:01.005077 15312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:01.005326 15312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:01.006488 15312 hybrid_clock.cc:648] HybridClock initialized: now 1790271241006465 us; error 43 us; skew 500 ppm
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271241, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:01.009333 15312 init.cc:377] Logged in from keytab as oryx/127.6.37.2@KRBTEST.COM (short username oryx)
I20260924 17:34:01.009802 15312 webserver.cc:460] Webserver started at http://127.6.37.2:39331/ using document root <none> and password file <none>
I20260924 17:34:01.010061 15312 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:01.010147 15312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:01.011636 15312 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 17:34:01.012276 15329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:01.012478 15312 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:34:01.012583 15312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "d96693e53c214d81b76c6c3c371b53a1"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "d6032232a2e15060326c57a53b2ab95f"
server_key_iv: "bdc83b04578ab13d89dfc05ea79874f5"
server_key_version: "encryptionkey@0"
I20260924 17:34:01.012929 15312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:01.025439 15312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:01.027468 15312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:01.027652 15312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:01.027889 15312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:01.028193 15312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:01.028249 15312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:01.028290 15312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:01.028318 15312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:01.034330 15312 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:39879
I20260924 17:34:01.034372 15442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:39879 every 8 connection(s)
I20260924 17:34:01.034716 15312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:34:01.036288 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15312
I20260924 17:34:01.036634 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:40373
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:42733
--webserver_port=43253
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:01.043030 15445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.035448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:49147)
0924 17:34:01.035603 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.035640 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.036189 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.036471 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.036476 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.037329 (+ 853us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.037615 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.037621 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.038501 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.038502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.039406 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.039409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.039961 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.039962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.040069 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.040618 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.040627 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.042804 (+ 2177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
W20260924 17:34:01.043067 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.035460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:49147 (local address 127.6.37.62:42733)
0924 17:34:01.035522 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.035524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.035731 (+ 207us) server_negotiation.cc:407] Connection header received
0924 17:34:01.036298 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.036300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.036314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.036386 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.037710 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.038402 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.039511 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.039869 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.039937 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.042980 (+ 3043us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:49147: BlockingRecv error: recv got EOF from 127.6.37.2:49147 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260924 17:34:01.043262 15443 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:42733 (0 consecutive failures): Not authorized: Failed to ping master at 127.6.37.62:42733: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:01.048305 15445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.043529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:47003)
0924 17:34:01.043565 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.043575 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.043616 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.043747 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.043748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.043877 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.043918 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.043919 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.044592 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.044593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.045516 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.045519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.045905 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.045906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.045993 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.046394 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.046400 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.048220 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":19}
W20260924 17:34:01.048357 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.043561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:47003 (local address 127.6.37.62:42733)
0924 17:34:01.043605 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.043608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.043616 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:34:01.043679 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.043680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.043689 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.043743 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.043993 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.044497 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.045604 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.045784 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.045882 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.048291 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:47003: BlockingRecv error: recv got EOF from 127.6.37.2:47003 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:01.052918 15445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.048600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:59325)
0924 17:34:01.048637 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.048648 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.048715 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.048905 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.048906 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.049026 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.049053 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.049054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.049710 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.049711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.050208 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.050210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.050593 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.050594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.050648 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.051149 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.051154 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.052846 (+ 1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260924 17:34:01.053030 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.048663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:59325 (local address 127.6.37.62:42733)
0924 17:34:01.048722 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.048724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.048748 (+ 24us) server_negotiation.cc:407] Connection header received
0924 17:34:01.048768 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.048769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.048778 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.048897 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.049135 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.049616 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.050309 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.050512 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.050592 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.052942 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:59325: BlockingRecv error: recv got EOF from 127.6.37.2:59325 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260924 17:34:01.053193 15443 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:34:01.122591 15446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:01.122808 15446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:01.122848 15446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:01.124061 15446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:01.124128 15446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:01.124174 15446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:34:01.125634 15446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/krb5kdc/oryx_127.6.37.3.keytab
--principal=oryx/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:40373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=43253
--tserver_master_addrs=127.6.37.62:42733
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:01.125900 15446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:01.126140 15446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:01.131392 15451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:01.131417 15446 server_base.cc:1034] running on GCE node
W20260924 17:34:01.131440 15452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:01.131383 15454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:01.131820 15446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:01.132131 15446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:01.133301 15446 hybrid_clock.cc:648] HybridClock initialized: now 1790271241133296 us; error 37 us; skew 500 ppm
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271241, etypes {rep=17 tkt=17 ses=17}, oryx/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:01.135854 15446 init.cc:377] Logged in from keytab as oryx/127.6.37.3@KRBTEST.COM (short username oryx)
I20260924 17:34:01.136396 15446 webserver.cc:460] Webserver started at http://127.6.37.3:43253/ using document root <none> and password file <none>
I20260924 17:34:01.136735 15446 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:01.136902 15446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:01.138419 15446 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:34:01.139169 15461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:01.139361 15446 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:01.139469 15446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "012941adbc6741cea830fcf6a182e7b6"
format_stamp: "Formatted at 2026-09-24 17:34:00 on dist-test-slave-gcz9"
server_key: "cdb31ae70866abdf41edbf7d7fcda7b4"
server_key_iv: "7ec8816beb0474849ec396fb5fedf2cc"
server_key_version: "encryptionkey@0"
I20260924 17:34:01.139906 15446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:01.146410 15446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:01.148463 15446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:01.148582 15446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:01.148782 15446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:01.149044 15446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:01.149080 15446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:01.149104 15446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:01.149119 15446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:01.155768 15446 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:40373
I20260924 17:34:01.155802 15575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:40373 every 8 connection(s)
I20260924 17:34:01.156184 15446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:34:01.162218 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15446
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
W20260924 17:34:01.164654 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.157056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:34529 (local address 127.6.37.62:42733)
0924 17:34:01.157132 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.157134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.157410 (+ 276us) server_negotiation.cc:407] Connection header received
0924 17:34:01.157930 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.157932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.157944 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.158011 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.159107 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.159622 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.160733 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.160939 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.161000 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.164563 (+ 3563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:34529: BlockingRecv error: recv got EOF from 127.6.37.3:34529 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260924 17:34:01.164959 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.157012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:34529)
0924 17:34:01.157207 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.157289 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.157823 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.158090 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.158093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.158700 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.158997 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.159004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.159714 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.159715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.160592 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.160595 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.161033 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.161034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.161151 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.161763 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.161773 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.164780 (+ 3007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":100,"threads_started":1}
W20260924 17:34:01.165169 15576 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:42733 (0 consecutive failures): Not authorized: Failed to ping master at 127.6.37.62:42733: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:01.170300 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.165455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:37621)
0924 17:34:01.165513 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.165525 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.165616 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.165844 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.165844 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.165981 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.166032 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.166033 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.166622 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.166623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.167548 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.167551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.167965 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.167966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.168039 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.168388 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.168393 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.170236 (+ 1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":37}
W20260924 17:34:01.170410 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.165512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:37621 (local address 127.6.37.62:42733)
0924 17:34:01.165554 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.165556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.165599 (+ 43us) server_negotiation.cc:407] Connection header received
0924 17:34:01.165675 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.165675 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.165684 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.165740 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.166114 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.166550 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.167619 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.167883 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.167945 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.170320 (+ 2375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:37621: BlockingRecv error: recv got EOF from 127.6.37.3:37621 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:34:01.171173 15313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.162893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53004 (local address 127.6.37.62:42733)
0924 17:34:01.163058 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.163060 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.163069 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:34:01.163093 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.163095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.163107 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.163194 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.163822 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.164573 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.165607 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.165909 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.165958 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.167479 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:01.167483 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:01.167484 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:01.167494 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:01.169451 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:01.169810 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:01.169815 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:01.169815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:01.169936 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:01.170125 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:01.170126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:01.170126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:01.170449 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:01.170615 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:01.170855 (+ 240us) server_negotiation.cc:299] Negotiation successful
0924 17:34:01.171055 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:01.175148 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.171141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:38317)
0924 17:34:01.171234 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.171246 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.171299 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.171429 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.171429 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.171565 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.171592 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.171593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.172281 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.172282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.172771 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.172773 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.173148 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.173149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.173202 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.173545 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.173549 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.175105 (+ 1556us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":76}
W20260924 17:34:01.175302 15311 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.171193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:38317 (local address 127.6.37.62:42733)
0924 17:34:01.171234 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.171237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.171284 (+ 47us) server_negotiation.cc:407] Connection header received
0924 17:34:01.171348 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.171349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.171357 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.171415 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.171670 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.172204 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.172868 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.173065 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.173146 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.175229 (+ 2083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:38317: BlockingRecv error: recv got EOF from 127.6.37.3:38317 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260924 17:34:01.175365 15576 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:01 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:01.918007 15580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:01.913313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:51451)
0924 17:34:01.913452 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:01.913464 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:01.913520 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:01.913658 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:01.913659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:01.913820 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:01.913872 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.913874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.914524 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.914525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.915111 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:01.915114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.915556 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.915557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:01.915603 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.916128 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:01.916133 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:01.917936 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
W20260924 17:34:01.918085 15581 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:01.913365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:51451 (local address 127.6.37.62:42733)
0924 17:34:01.913509 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:01.913511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:01.913522 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:34:01.913576 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:01.913577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:01.913586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:01.913639 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:01.913938 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.914459 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.915229 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:01.915486 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:01.915547 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:01.918028 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:51451: BlockingRecv error: recv got EOF from 127.6.37.1:51451 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
Sep 24 17:34:02 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:02 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:02.058269 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:02.053557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:45111)
0924 17:34:02.053687 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:02.053700 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:02.053765 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:02.053938 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:02.053939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:02.054110 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:02.054160 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:02.054163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.055101 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.055101 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:02.055640 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:02.055642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.056039 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.056040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:02.056080 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:02.056533 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:02.056538 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:02.058202 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":57,"threads_started":1}
W20260924 17:34:02.058419 15581 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:02.053623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:45111 (local address 127.6.37.62:42733)
0924 17:34:02.053708 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:02.053711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:02.053767 (+ 56us) server_negotiation.cc:407] Connection header received
0924 17:34:02.053852 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:02.053853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:02.053865 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:02.053918 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:02.054226 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.054775 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.055734 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.055958 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.056023 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:02.058336 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:45111: BlockingRecv error: recv got EOF from 127.6.37.2:45111 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 24 17:34:02 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:02 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:02.181113 15583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:02.175755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:39335)
0924 17:34:02.175891 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:02.175903 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:02.175959 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:02.176167 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:02.176168 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:02.176412 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:02.176487 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:02.176489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.177592 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.177593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:02.178152 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:02.178155 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.178577 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.178578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:02.178619 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:02.179160 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:02.179164 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:02.181043 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
W20260924 17:34:02.181249 15581 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:02.175961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:39335 (local address 127.6.37.62:42733)
0924 17:34:02.176033 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:02.176035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:02.176042 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:34:02.176071 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:02.176072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:02.176084 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:02.176143 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:02.176572 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.177481 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.178270 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.178497 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.178570 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:02.181143 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:39335: BlockingRecv error: recv got EOF from 127.6.37.3:39335 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 24 17:34:02 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:02 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:02.923579 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:02.918540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:47423)
0924 17:34:02.918702 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:02.918713 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:02.918769 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:02.918935 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:02.918936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:02.919106 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:02.919158 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:02.919160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.920052 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.920053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:02.920572 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:02.920573 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.920976 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.920977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:02.921025 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:02.921492 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:02.921497 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:02.923519 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
W20260924 17:34:02.923727 15585 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:02.918630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47423 (local address 127.6.37.62:42733)
0924 17:34:02.918755 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:02.918757 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:02.918767 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:34:02.918811 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:02.918811 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:02.918824 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:02.918915 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:02.919262 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.919972 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.920665 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:02.920903 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:02.920969 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:02.923624 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:47423: BlockingRecv error: recv got EOF from 127.6.37.1:47423 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
Sep 24 17:34:03 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:03 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:03.063627 15586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:03.058766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:48513)
0924 17:34:03.058942 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:03.058954 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:03.059023 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:03.059186 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:03.059187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:03.059390 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:03.059442 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:03.059443 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.060080 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.060080 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:03.060636 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:03.060638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.061055 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.061057 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:03.061132 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:03.061655 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:03.061660 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:03.063568 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":147,"threads_started":1}
W20260924 17:34:03.063827 15585 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:03.058859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:48513 (local address 127.6.37.62:42733)
0924 17:34:03.058932 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:03.058934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:03.059010 (+ 76us) server_negotiation.cc:407] Connection header received
0924 17:34:03.059071 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:03.059072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:03.059083 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:03.059140 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:03.059519 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.060011 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.060720 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.060911 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.060968 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:03.063731 (+ 2763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:48513: BlockingRecv error: recv got EOF from 127.6.37.2:48513 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 24 17:34:03 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:03 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:03.186355 15587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:03.181669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:46843)
0924 17:34:03.181876 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:03.181891 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:03.181965 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:03.182139 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:03.182140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:03.182371 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:03.182436 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:03.182439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.183153 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.183154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:03.183691 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:03.183692 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.184005 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.184006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:03.184046 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:03.184553 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:03.184559 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:03.186284 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":74,"threads_started":1}
W20260924 17:34:03.186424 15585 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:03.181847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:46843 (local address 127.6.37.62:42733)
0924 17:34:03.181925 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:03.181927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:03.181945 (+ 18us) server_negotiation.cc:407] Connection header received
0924 17:34:03.182031 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:03.182033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:03.182049 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:03.182114 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:03.182524 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.183084 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.183765 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.183942 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.183991 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:03.186375 (+ 2384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:46843: BlockingRecv error: recv got EOF from 127.6.37.3:46843 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 24 17:34:03 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:03 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:03.928489 15588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:03.924057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:51317)
0924 17:34:03.924201 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:03.924211 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:03.924262 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:03.924430 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:03.924431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:03.924602 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:03.924654 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:03.924656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.925313 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.925314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:03.925840 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:03.925842 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.926189 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.926190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:03.926230 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:03.926707 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:03.926711 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:03.928432 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":96,"threads_started":1}
W20260924 17:34:03.928689 15589 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:03.924146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:51317 (local address 127.6.37.62:42733)
0924 17:34:03.924293 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:03.924295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:03.924303 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:34:03.924326 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:03.924326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:03.924337 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:03.924415 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:03.924730 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.925244 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.925927 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:03.926122 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:03.926177 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:03.928586 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:51317: BlockingRecv error: recv got EOF from 127.6.37.1:51317 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
Sep 24 17:34:04 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:04 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:04.069108 15590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:04.064116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:53153)
0924 17:34:04.064279 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:04.064291 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:04.064365 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:04.064546 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:04.064547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:04.064747 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:04.064845 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:04.064848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.065502 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.065503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:04.066187 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:04.066190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.066534 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.066535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:04.066583 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:04.067235 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:04.067239 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:04.069008 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":67,"threads_started":1}
W20260924 17:34:04.069168 15589 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:04.064176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:53153 (local address 127.6.37.62:42733)
0924 17:34:04.064256 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:04.064258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:04.064357 (+ 99us) server_negotiation.cc:407] Connection header received
0924 17:34:04.064425 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:04.064426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:04.064436 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:04.064514 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:04.064915 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.065423 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.066272 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.066464 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.066517 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:04.069108 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:53153: BlockingRecv error: recv got EOF from 127.6.37.2:53153 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 24 17:34:04 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:04 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:04.192263 15591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:04.187012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:56863)
0924 17:34:04.187169 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:04.187190 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:04.187264 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:04.187464 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:04.187465 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:04.187655 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:04.187710 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:04.187712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.188452 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.188453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:04.189081 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:04.189083 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.189510 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.189511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:04.189600 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:04.190130 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:04.190135 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:04.192193 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
W20260924 17:34:04.192374 15589 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:04.187209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:56863 (local address 127.6.37.62:42733)
0924 17:34:04.187320 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:04.187322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:04.187332 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:34:04.187367 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:04.187368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:04.187380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:04.187450 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:04.187805 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.188359 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.189181 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.189414 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.189511 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:04.192276 (+ 2765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:56863: BlockingRecv error: recv got EOF from 127.6.37.3:56863 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 24 17:34:04 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:04 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:04.933961 15592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:04.928964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:44817)
0924 17:34:04.929111 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:04.929121 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:04.929192 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:04.929386 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:04.929387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:04.929571 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:04.929625 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:04.929627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.930432 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.930432 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:04.931121 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:04.931124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.931547 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.931549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:04.931606 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:04.932044 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:04.932049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:04.933884 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":92,"threads_started":1}
W20260924 17:34:04.934093 15593 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:04.929046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:44817 (local address 127.6.37.62:42733)
0924 17:34:04.929217 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:04.929219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:04.929264 (+ 45us) server_negotiation.cc:407] Connection header received
0924 17:34:04.929295 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:04.929296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:04.929308 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:04.929371 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:04.929736 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.930364 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.931231 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:04.931455 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:04.931546 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:04.933977 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:44817: BlockingRecv error: recv got EOF from 127.6.37.1:44817 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":128,"threads_started":1}
Sep 24 17:34:05 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:05 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:05.074834 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:05.069638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:33539)
0924 17:34:05.069965 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:05.069984 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:05.070076 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:05.070259 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:05.070259 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:05.070446 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:05.070502 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:05.070504 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.071223 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.071224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:05.072007 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:05.072010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.072378 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.072379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:05.072440 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:05.072875 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:05.072880 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:05.074730 (+ 1850us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":100,"threads_started":1}
W20260924 17:34:05.074905 15593 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:05.069753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:33539 (local address 127.6.37.62:42733)
0924 17:34:05.069935 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:05.069937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:05.070056 (+ 119us) server_negotiation.cc:407] Connection header received
0924 17:34:05.070165 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:05.070166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:05.070185 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:05.070250 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:05.070586 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.071141 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.072076 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.072283 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.072376 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:05.074815 (+ 2439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:33539: BlockingRecv error: recv got EOF from 127.6.37.2:33539 (error 108)
Metrics: {"server-negotiator.queue_time_us":149}
Sep 24 17:34:05 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:05 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:05.197237 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:05.192722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:43273)
0924 17:34:05.192870 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:05.192881 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:05.192937 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:05.193052 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:05.193052 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:05.193213 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:05.193263 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:05.193265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.193890 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.193890 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:05.194423 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:05.194424 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.194774 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.194774 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:05.194822 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:05.195336 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:05.195342 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:05.197176 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
W20260924 17:34:05.197328 15593 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:05.192784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:43273 (local address 127.6.37.62:42733)
0924 17:34:05.192857 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:05.192859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:05.192940 (+ 81us) server_negotiation.cc:407] Connection header received
0924 17:34:05.192982 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:05.192983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:05.192996 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:05.193045 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:05.193319 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.193818 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.194512 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.194704 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.194758 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:05.197277 (+ 2519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:43273: BlockingRecv error: recv got EOF from 127.6.37.3:43273 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 24 17:34:05 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:05 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:05.938979 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:05.934414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:43395)
0924 17:34:05.934556 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:05.934566 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:05.934616 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:05.934767 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:05.934768 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:05.934986 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:05.935052 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:05.935054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.935749 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.935750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:05.936281 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:05.936282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.936694 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.936695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:05.936735 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:05.937182 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:05.937187 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:05.938853 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
W20260924 17:34:05.939081 15597 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:05.934496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:43395 (local address 127.6.37.62:42733)
0924 17:34:05.934627 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:05.934629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:05.934668 (+ 39us) server_negotiation.cc:407] Connection header received
0924 17:34:05.934692 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:05.934693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:05.934705 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:05.934763 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:05.935146 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.935676 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.936376 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:05.936617 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:05.936687 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:05.939005 (+ 2318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:43395: BlockingRecv error: recv got EOF from 127.6.37.1:43395 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
Sep 24 17:34:06 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:06 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:06.079788 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:06.075331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:39717)
0924 17:34:06.075467 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:06.075477 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:06.075524 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:06.075661 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:06.075662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:06.075821 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:06.075872 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:06.075873 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.076553 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.076554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:06.077075 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:06.077076 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.077463 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.077463 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:06.077503 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:06.077965 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:06.077969 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:06.079730 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
W20260924 17:34:06.079969 15597 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:06.075456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:39717 (local address 127.6.37.62:42733)
0924 17:34:06.075515 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:06.075517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:06.075525 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:34:06.075579 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:06.075580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:06.075591 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:06.075651 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:06.075936 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.076481 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.077167 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.077376 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.077455 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:06.079897 (+ 2442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:39717: BlockingRecv error: recv got EOF from 127.6.37.2:39717 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Sep 24 17:34:06 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:06 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:06.202581 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:06.197851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:43181)
0924 17:34:06.198041 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:06.198052 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:06.198109 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:06.198263 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:06.198264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:06.198423 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:06.198475 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:06.198477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.199197 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.199197 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:06.199838 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:06.199857 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.200323 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.200324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:06.200366 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:06.200812 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:06.200816 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:06.202520 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":107,"threads_started":1}
W20260924 17:34:06.202726 15597 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:06.197970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:43181 (local address 127.6.37.62:42733)
0924 17:34:06.198030 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:06.198032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:06.198096 (+ 64us) server_negotiation.cc:407] Connection header received
0924 17:34:06.198176 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:06.198177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:06.198191 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:06.198239 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:06.198589 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.199123 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.199940 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.200256 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.200322 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:06.202638 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:43181: BlockingRecv error: recv got EOF from 127.6.37.3:43181 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Sep 24 17:34:06 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:06 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:06.951187 15600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:06.939496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:45055)
0924 17:34:06.939628 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:06.939643 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:06.939694 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:06.939836 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:06.939837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:06.939996 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:06.940052 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:06.940053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.940742 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.940743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:06.941306 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:06.941309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.941651 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.941652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:06.941697 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:06.949234 (+ 7537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:06.949239 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:06.951125 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
W20260924 17:34:06.951299 15601 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:06.939531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:45055 (local address 127.6.37.62:42733)
0924 17:34:06.939686 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:06.939688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:06.939697 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:34:06.939739 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:06.939740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:06.939750 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:06.939811 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:06.940116 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.940660 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.941385 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:06.941582 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:06.941631 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:06.951224 (+ 9593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:45055: BlockingRecv error: recv got EOF from 127.6.37.1:45055 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":101,"threads_started":1}
Sep 24 17:34:07 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:07 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:07.085702 15602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:07.080298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:41613)
0924 17:34:07.080433 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:07.080449 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:07.080497 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:07.080635 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:07.080636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:07.080800 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:07.080856 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:07.080858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.081605 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.081606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:07.082211 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:07.082214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.082964 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.082965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:07.083045 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:07.083732 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:07.083739 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:07.085644 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
W20260924 17:34:07.085866 15601 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:07.080394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41613 (local address 127.6.37.62:42733)
0924 17:34:07.080497 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:07.080498 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:07.080535 (+ 37us) server_negotiation.cc:407] Connection header received
0924 17:34:07.080565 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:07.080566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:07.080577 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:07.080631 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:07.080954 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.081515 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.082384 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.082784 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.082951 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:07.085766 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:41613: BlockingRecv error: recv got EOF from 127.6.37.2:41613 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 24 17:34:07 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:07 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:07.207759 15603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:07.203090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:41125)
0924 17:34:07.203263 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:07.203276 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:07.203357 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:07.203529 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:07.203530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:07.203711 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:07.203789 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:07.203791 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.204457 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.204458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:07.205051 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:07.205053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.205382 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.205383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:07.205429 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:07.205906 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:07.205912 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:07.207698 (+ 1786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
W20260924 17:34:07.207891 15601 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:07.203168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:41125 (local address 127.6.37.62:42733)
0924 17:34:07.203247 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:07.203249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:07.203358 (+ 109us) server_negotiation.cc:407] Connection header received
0924 17:34:07.203404 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:07.203405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:07.203417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:07.203463 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:07.203864 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.204378 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.205131 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.205312 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.205361 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:07.207823 (+ 2462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:41125: BlockingRecv error: recv got EOF from 127.6.37.3:41125 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 24 17:34:07 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:07 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:07.956228 15604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:07.951741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:47045)
0924 17:34:07.951894 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:07.951907 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:07.951978 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:07.952171 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:07.952171 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:07.952333 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:07.952386 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:07.952388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.953029 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.953030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:07.953564 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:07.953565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.953882 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.953883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:07.953922 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:07.954422 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:07.954432 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:07.956171 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":89,"threads_started":1}
W20260924 17:34:07.956436 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:07.951774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47045 (local address 127.6.37.62:42733)
0924 17:34:07.951918 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:07.951921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:07.951962 (+ 41us) server_negotiation.cc:407] Connection header received
0924 17:34:07.952071 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:07.952072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:07.952085 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:07.952150 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:07.952449 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.952957 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.953636 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:07.953821 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:07.953870 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:07.956344 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:47045: BlockingRecv error: recv got EOF from 127.6.37.1:47045 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
Sep 24 17:34:08 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:08 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:08.091084 15606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:08.086523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:55033)
0924 17:34:08.086703 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:08.086713 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:08.086775 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:08.086931 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:08.086932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:08.087098 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:08.087150 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:08.087152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.087813 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.087814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:08.088316 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:08.088317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.088677 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.088678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:08.088717 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:08.089244 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:08.089248 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:08.091026 (+ 1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
W20260924 17:34:08.091297 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:08.086602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:55033 (local address 127.6.37.62:42733)
0924 17:34:08.086709 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:08.086711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:08.086777 (+ 66us) server_negotiation.cc:407] Connection header received
0924 17:34:08.086829 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:08.086830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:08.086841 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:08.086923 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:08.087221 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.087743 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.088395 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.088588 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.088670 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:08.091208 (+ 2538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:55033: BlockingRecv error: recv got EOF from 127.6.37.2:55033 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Sep 24 17:34:08 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:08 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:08.213020 15607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:08.208244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:55553)
0924 17:34:08.208410 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:08.208421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:08.208476 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:08.208604 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:08.208604 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:08.208819 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:08.208883 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:08.208885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.209593 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.209593 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:08.210133 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:08.210135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.210484 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.210485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:08.210525 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:08.211065 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:08.211071 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:08.212953 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":106,"threads_started":1}
W20260924 17:34:08.213217 15605 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:08.208351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:55553 (local address 127.6.37.62:42733)
0924 17:34:08.208400 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:08.208402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:08.208465 (+ 63us) server_negotiation.cc:407] Connection header received
0924 17:34:08.208524 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:08.208524 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:08.208537 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:08.208596 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:08.208985 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.209500 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.210212 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.210413 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.210470 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:08.213124 (+ 2654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:55553: BlockingRecv error: recv got EOF from 127.6.37.3:55553 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Sep 24 17:34:08 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:08 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:08.961352 15608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:08.956778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:53011)
0924 17:34:08.956936 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:08.956951 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:08.957016 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:08.957189 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:08.957190 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:08.957358 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:08.957410 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:08.957411 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.958058 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.958059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:08.958592 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:08.958594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.958996 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.958997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:08.959045 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:08.959556 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:08.959560 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:08.961287 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":72,"threads_started":1}
W20260924 17:34:08.961514 15609 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:08.956926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:53011 (local address 127.6.37.62:42733)
0924 17:34:08.957067 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:08.957069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:08.957076 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:34:08.957100 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:08.957100 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:08.957110 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:08.957169 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:08.957475 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.957993 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.958685 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:08.958924 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:08.958987 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:08.961424 (+ 2437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:53011: BlockingRecv error: recv got EOF from 127.6.37.1:53011 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
Sep 24 17:34:09 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:09 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:09.096621 15610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:09.091615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:51077)
0924 17:34:09.091773 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:09.091783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:09.091833 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:09.091975 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:09.091976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:09.092134 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:09.092185 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:09.092186 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.092990 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.092991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:09.093518 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:09.093520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.093831 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.093832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:09.093870 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:09.094369 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:09.094374 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:09.096560 (+ 2186us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
W20260924 17:34:09.096724 15609 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:09.091687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:51077 (local address 127.6.37.62:42733)
0924 17:34:09.091766 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:09.091769 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:09.091834 (+ 65us) server_negotiation.cc:407] Connection header received
0924 17:34:09.091898 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:09.091898 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:09.091909 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:09.091953 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:09.092246 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.092923 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.093588 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.093769 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.093817 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:09.096654 (+ 2837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:51077: BlockingRecv error: recv got EOF from 127.6.37.2:51077 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 24 17:34:09 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:09 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:09.218421 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:09.213632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:39753)
0924 17:34:09.213832 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:09.213861 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:09.213932 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:09.214128 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:09.214129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:09.214320 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:09.214370 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:09.214372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.215090 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.215091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:09.215681 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:09.215683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.216065 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.216065 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:09.216106 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:09.216627 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:09.216631 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:09.218362 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":129,"threads_started":1}
W20260924 17:34:09.218593 15609 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:09.213695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:39753 (local address 127.6.37.62:42733)
0924 17:34:09.213773 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:09.213776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:09.213972 (+ 196us) server_negotiation.cc:407] Connection header received
0924 17:34:09.214000 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:09.214001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:09.214014 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:09.214089 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:09.214446 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.215017 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.215771 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.215994 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.216058 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:09.218491 (+ 2433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:39753: BlockingRecv error: recv got EOF from 127.6.37.3:39753 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 24 17:34:09 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:09 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:09.966990 15612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:09.961758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:54675)
0924 17:34:09.961923 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:09.961935 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:09.962013 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:09.962224 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:09.962226 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:09.962463 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:09.962572 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:09.962574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.963352 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.963353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:09.963972 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:09.963974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.964345 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.964347 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:09.964400 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:09.964852 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:09.964856 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:09.966850 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":95,"threads_started":1}
W20260924 17:34:09.967061 15613 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:09.961848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:54675 (local address 127.6.37.62:42733)
0924 17:34:09.961959 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:09.961961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:09.961992 (+ 31us) server_negotiation.cc:407] Connection header received
0924 17:34:09.962090 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:09.962091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:09.962106 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:09.962195 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:09.962653 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.963265 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.964059 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:09.964245 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:09.964296 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:09.966976 (+ 2680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:54675: BlockingRecv error: recv got EOF from 127.6.37.1:54675 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":50,"threads_started":1}
Sep 24 17:34:10 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:10 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:10.102550 15614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:10.097174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:32787)
0924 17:34:10.097439 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:10.097453 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:10.097539 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:10.097697 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:10.097699 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:10.097945 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:10.097996 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:10.097999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.098705 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.098707 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:10.099285 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:10.099287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.099684 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.099685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:10.099749 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:10.100364 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:10.100368 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:10.102440 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":81,"threads_started":1}
W20260924 17:34:10.102631 15613 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:10.097267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:32787 (local address 127.6.37.62:42733)
0924 17:34:10.097443 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:10.097445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:10.097517 (+ 72us) server_negotiation.cc:407] Connection header received
0924 17:34:10.097600 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:10.097601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:10.097615 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:10.097688 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:10.098094 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.098600 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.099395 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.099596 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.099683 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:10.102556 (+ 2873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:32787: BlockingRecv error: recv got EOF from 127.6.37.2:32787 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
Sep 24 17:34:10 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:10 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:10.224076 15615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:10.219067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:42417)
0924 17:34:10.219331 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:10.219344 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:10.219416 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:10.219561 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:10.219562 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:10.219720 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:10.219772 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:10.219773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.220421 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.220422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:10.220949 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:10.220951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.221444 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.221445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:10.221486 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:10.221971 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:10.221975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:10.224017 (+ 2042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":87,"threads_started":1}
W20260924 17:34:10.224180 15613 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:10.219150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:42417 (local address 127.6.37.62:42733)
0924 17:34:10.219371 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:10.219373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:10.219400 (+ 27us) server_negotiation.cc:407] Connection header received
0924 17:34:10.219477 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:10.219478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:10.219490 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:10.219543 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:10.219838 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.220354 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.221172 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.221372 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.221433 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:10.224107 (+ 2674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:42417: BlockingRecv error: recv got EOF from 127.6.37.3:42417 (error 108)
Metrics: {"server-negotiator.queue_time_us":194}
Sep 24 17:34:10 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:10 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:10.972160 15616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:10.967419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:56413)
0924 17:34:10.967548 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:10.967562 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:10.967611 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:10.967743 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:10.967744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:10.967932 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:10.967997 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:10.967999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.968698 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.968699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:10.969314 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:10.969317 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.969703 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.969704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:10.969753 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:10.970260 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:10.970265 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:10.972100 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
W20260924 17:34:10.972332 15617 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:10.967490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:56413 (local address 127.6.37.62:42733)
0924 17:34:10.967615 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:10.967616 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:10.967643 (+ 27us) server_negotiation.cc:407] Connection header received
0924 17:34:10.967664 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:10.967665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:10.967676 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:10.967723 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:10.968062 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.968586 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.969408 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:10.969625 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:10.969681 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:10.972221 (+ 2540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:56413: BlockingRecv error: recv got EOF from 127.6.37.1:56413 (error 108)
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
Sep 24 17:34:11 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:11 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:11.108208 15618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:11.103230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:41001)
0924 17:34:11.103434 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:11.103446 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:11.103524 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:11.103700 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:11.103701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:11.103897 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:11.103946 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:11.103947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.104705 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.104706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:11.105534 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:11.105537 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.105925 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.105926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:11.105985 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:11.106418 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:11.106423 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:11.108150 (+ 1727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":96,"threads_started":1}
W20260924 17:34:11.108368 15617 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:11.103338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41001 (local address 127.6.37.62:42733)
0924 17:34:11.103416 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:11.103418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:11.103517 (+ 99us) server_negotiation.cc:407] Connection header received
0924 17:34:11.103594 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:11.103595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:11.103610 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:11.103677 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:11.104027 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.104607 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.105628 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.105820 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.105911 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:11.108282 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:41001: BlockingRecv error: recv got EOF from 127.6.37.2:41001 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 24 17:34:11 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:11 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:11.229501 15619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:11.224629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:53861)
0924 17:34:11.224827 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:11.224952 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:11.225009 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:11.225231 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:11.225232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:11.225432 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:11.225486 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:11.225488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.226105 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.226106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:11.226636 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:11.226638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.226970 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.226971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:11.227039 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:11.227486 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:11.227492 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:11.229440 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":67,"threads_started":1}
W20260924 17:34:11.229630 15617 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:11.224756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:53861 (local address 127.6.37.62:42733)
0924 17:34:11.224857 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:11.224859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:11.225012 (+ 153us) server_negotiation.cc:407] Connection header received
0924 17:34:11.225114 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:11.225115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:11.225132 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:11.225205 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:11.225550 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.226035 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.226706 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.226906 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.226962 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:11.229553 (+ 2591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:53861: BlockingRecv error: recv got EOF from 127.6.37.3:53861 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 24 17:34:11 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:11 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:11.985098 15620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:11.972857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:33779)
0924 17:34:11.973039 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:11.973050 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:11.973115 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:11.973247 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:11.973247 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:11.973411 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:11.973463 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:11.973465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.974182 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.974182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:11.974710 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:11.974712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.975106 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.975107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:11.975151 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:11.983203 (+ 8052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:11.983208 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:11.985040 (+ 1832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
W20260924 17:34:11.985263 15621 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:11.972929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:33779 (local address 127.6.37.62:42733)
0924 17:34:11.973043 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:11.973045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:11.973101 (+ 56us) server_negotiation.cc:407] Connection header received
0924 17:34:11.973160 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:11.973160 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:11.973170 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:11.973227 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:11.973531 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.974115 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.974787 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:11.975043 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:11.975100 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:11.985168 (+ 10068us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:33779: BlockingRecv error: recv got EOF from 127.6.37.1:33779 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":48,"threads_started":1}
Sep 24 17:34:12 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:12 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:12.113348 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:12.108773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:43363)
0924 17:34:12.108919 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:12.108948 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:12.109020 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:12.109181 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:12.109182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:12.109352 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:12.109402 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:12.109404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.110084 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.110085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:12.110609 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:12.110611 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.110994 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.110995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:12.111039 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:12.111566 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:12.111570 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:12.113291 (+ 1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
W20260924 17:34:12.113488 15621 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:12.108838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:43363 (local address 127.6.37.62:42733)
0924 17:34:12.108888 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:12.108890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:12.109019 (+ 129us) server_negotiation.cc:407] Connection header received
0924 17:34:12.109081 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:12.109082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:12.109097 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:12.109157 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:12.109476 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.110015 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.110683 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.110932 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.110986 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:12.113406 (+ 2420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:43363: BlockingRecv error: recv got EOF from 127.6.37.2:43363 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Sep 24 17:34:12 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:12 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:12.234819 15623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:12.229971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:47773)
0924 17:34:12.230150 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:12.230165 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:12.230220 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:12.230377 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:12.230378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:12.230545 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:12.230648 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:12.230650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.231359 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.231359 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:12.231879 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:12.231880 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.232215 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.232216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:12.232285 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:12.232820 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:12.232826 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:12.234726 (+ 1900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":124,"threads_started":1}
W20260924 17:34:12.234858 15621 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:12.230074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:47773 (local address 127.6.37.62:42733)
0924 17:34:12.230152 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:12.230154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:12.230227 (+ 73us) server_negotiation.cc:407] Connection header received
0924 17:34:12.230266 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:12.230266 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:12.230294 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:12.230373 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:12.230718 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.231292 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.231949 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.232136 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.232214 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:12.234797 (+ 2583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:47773: BlockingRecv error: recv got EOF from 127.6.37.3:47773 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 24 17:34:12 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:12 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:12.990599 15624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:12.985586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:47557)
0924 17:34:12.985729 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:12.985742 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:12.985812 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:12.985950 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:12.985950 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:12.986115 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:12.986167 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:12.986168 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.986976 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.986979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:12.987697 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:12.987700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.988088 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.988089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:12.988146 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:12.988652 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:12.988657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:12.990503 (+ 1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
W20260924 17:34:12.990658 15625 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:12.985676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47557 (local address 127.6.37.62:42733)
0924 17:34:12.985815 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:12.985817 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:12.985843 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:34:12.985866 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:12.985866 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:12.985877 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:12.985927 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:12.986271 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.986868 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.987789 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:12.988004 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:12.988076 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:12.990586 (+ 2510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:47557: BlockingRecv error: recv got EOF from 127.6.37.1:47557 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
Sep 24 17:34:13 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:13 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:13.118795 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:13.113826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:54481)
0924 17:34:13.114008 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:13.114020 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:13.114087 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:13.114218 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:13.114219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:13.114386 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:13.114438 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:13.114439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.115232 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.115234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:13.115778 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:13.115780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.116216 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.116217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:13.116263 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:13.116883 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:13.116888 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:13.118728 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":90,"threads_started":1}
W20260924 17:34:13.119017 15625 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:13.113940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:54481 (local address 127.6.37.62:42733)
0924 17:34:13.114022 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:13.114024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:13.114068 (+ 44us) server_negotiation.cc:407] Connection header received
0924 17:34:13.114142 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:13.114143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:13.114153 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:13.114196 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:13.114513 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.115143 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.115857 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.116126 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.116192 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:13.118951 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:54481: BlockingRecv error: recv got EOF from 127.6.37.2:54481 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Sep 24 17:34:13 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:13 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:13.240118 15628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:13.235516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:36741)
0924 17:34:13.235708 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:13.235736 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:13.235814 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:13.236004 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:13.236005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:13.236173 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:13.236226 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:13.236228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.236889 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.236890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:13.237415 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:13.237417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.237743 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.237743 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:13.237785 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:13.238297 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:13.238303 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:13.240047 (+ 1744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
W20260924 17:34:13.240218 15625 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:13.235606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:36741 (local address 127.6.37.62:42733)
0924 17:34:13.235733 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:13.235736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:13.235796 (+ 60us) server_negotiation.cc:407] Connection header received
0924 17:34:13.235910 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:13.235911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:13.235932 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:13.235982 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:13.236289 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.236790 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.237486 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.237676 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.237727 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:13.240148 (+ 2421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:36741: BlockingRecv error: recv got EOF from 127.6.37.3:36741 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Sep 24 17:34:13 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:13 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:13.995746 15629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:13.991162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:59355)
0924 17:34:13.991298 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:13.991309 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:13.991387 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:13.991555 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:13.991556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:13.991769 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:13.991828 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:13.991831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.992535 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.992536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:13.993068 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:13.993069 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.993439 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.993440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:13.993479 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:13.993955 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:13.993960 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:13.995691 (+ 1731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
W20260924 17:34:13.995947 15630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:13.991235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:59355 (local address 127.6.37.62:42733)
0924 17:34:13.991380 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:13.991383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:13.991392 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:34:13.991443 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:13.991444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:13.991459 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:13.991537 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:13.991903 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.992465 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.993149 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:13.993370 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:13.993430 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:13.995880 (+ 2450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:59355: BlockingRecv error: recv got EOF from 127.6.37.1:59355 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":100,"threads_started":1}
Sep 24 17:34:14 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:14 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:14.124607 15631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:14.119306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:60977)
0924 17:34:14.119487 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:14.119498 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:14.119578 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:14.119833 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:14.119835 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:14.120075 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:14.120143 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:14.120145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.120893 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.120894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:14.121547 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:14.121549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.121936 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.121937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:14.121988 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:14.122594 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:14.122600 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:14.124524 (+ 1924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":117,"threads_started":1}
W20260924 17:34:14.124682 15630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:14.119437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:60977 (local address 127.6.37.62:42733)
0924 17:34:14.119505 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:14.119507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:14.119538 (+ 31us) server_negotiation.cc:407] Connection header received
0924 17:34:14.119665 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:14.119666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:14.119679 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:14.119740 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:14.120221 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.120776 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.121661 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.121855 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.121919 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:14.124634 (+ 2715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:60977: BlockingRecv error: recv got EOF from 127.6.37.2:60977 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 24 17:34:14 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:14 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:14.245388 15632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:14.240660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:41831)
0924 17:34:14.240813 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:14.240829 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:14.240884 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:14.241031 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:14.241032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:14.241191 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:14.241244 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:14.241245 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.241993 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.241994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:14.242585 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:14.242588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.243035 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.243036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:14.243078 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:14.243656 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:14.243661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:14.245316 (+ 1655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":103,"threads_started":1}
W20260924 17:34:14.245555 15630 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:14.240674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:41831 (local address 127.6.37.62:42733)
0924 17:34:14.240727 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:14.240729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:14.240887 (+ 158us) server_negotiation.cc:407] Connection header received
0924 17:34:14.240933 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:14.240933 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:14.240949 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:14.241010 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:14.241312 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.241909 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.242704 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.242954 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.243023 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:14.245457 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:41831: BlockingRecv error: recv got EOF from 127.6.37.3:41831 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Sep 24 17:34:14 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:14 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:15.001011 15633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:14.996345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:47835)
0924 17:34:14.996501 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:14.996512 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:14.996572 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:14.996755 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:14.996756 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:14.996914 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:14.996967 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:14.996969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.997602 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.997603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:14.998141 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:14.998143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.998481 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.998482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:14.998521 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:14.999030 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:14.999035 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:15.000899 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
W20260924 17:34:15.001067 15634 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:14.996405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47835 (local address 127.6.37.62:42733)
0924 17:34:14.996553 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:14.996557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:14.996571 (+ 14us) server_negotiation.cc:407] Connection header received
0924 17:34:14.996646 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:14.996646 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:14.996656 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:14.996737 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:14.997034 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.997526 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.998212 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:14.998417 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:14.998469 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:15.000985 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:47835: BlockingRecv error: recv got EOF from 127.6.37.1:47835 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
Sep 24 17:34:15 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:15 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:15.129658 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:15.125247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:38237)
0924 17:34:15.125387 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:15.125397 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:15.125461 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:15.125590 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:15.125591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:15.125753 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:15.125805 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:15.125806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.126444 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.126445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:15.127009 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:15.127011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.127343 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.127343 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:15.127381 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:15.127809 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:15.127814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:15.129549 (+ 1735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
W20260924 17:34:15.129719 15634 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:15.125317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:38237 (local address 127.6.37.62:42733)
0924 17:34:15.125398 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:15.125404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:15.125447 (+ 43us) server_negotiation.cc:407] Connection header received
0924 17:34:15.125507 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:15.125507 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:15.125518 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:15.125570 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:15.125882 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.126378 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.127079 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.127272 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.127337 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:15.129630 (+ 2293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:38237: BlockingRecv error: recv got EOF from 127.6.37.2:38237 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 24 17:34:15 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:15 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.3@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:15.250474 15636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:15.245893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.3:52141)
0924 17:34:15.246034 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:15.246044 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:15.246099 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:15.246237 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:15.246237 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:15.246405 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:15.246457 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:15.246459 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.247117 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.247118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:15.247669 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:15.247671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.247996 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.247996 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:15.248036 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:15.248506 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:15.248511 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:15.250356 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":79,"threads_started":1}
W20260924 17:34:15.250506 15634 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:15.245975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:52141 (local address 127.6.37.62:42733)
0924 17:34:15.246052 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:15.246054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:15.246088 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:34:15.246159 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:15.246160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:15.246172 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:15.246213 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:15.246520 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.247048 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.247745 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:15.247932 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:15.247983 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:15.250437 (+ 2454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.3:52141: BlockingRecv error: recv got EOF from 127.6.37.3:52141 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 24 17:34:15 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:15 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.1@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:16.006523 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.001674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.1:42335)
0924 17:34:16.001855 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:16.001866 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:16.001921 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:16.002084 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:16.002084 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:16.002242 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:16.002295 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.002296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.002962 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.002963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.003487 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.003488 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.003952 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.003953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.003993 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.004481 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:16.004486 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:16.006430 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":102,"threads_started":1}
W20260924 17:34:16.006582 15638 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:16.001765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:42335 (local address 127.6.37.62:42733)
0924 17:34:16.001942 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.001944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.001954 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:34:16.001987 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.001988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.002000 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.002066 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.002359 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.002874 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.003640 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.003880 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.003944 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.006510 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.1:42335: BlockingRecv error: recv got EOF from 127.6.37.1:42335 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":124,"threads_started":1}
Sep 24 17:34:16 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
Sep 24 17:34:16 dist-test-slave-gcz9 krb5kdc[14567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.6.37.2@KRBTEST.COM for oryx/127.6.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260924 17:34:16.134644 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.130198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42733 (local address 127.6.37.2:51321)
0924 17:34:16.130317 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:16.130329 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:16.130392 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:16.130539 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:16.130540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:16.130695 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:16.130745 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.130746 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.131537 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.131538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.132057 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.132058 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.132404 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.132404 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.132445 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.132892 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:16.132896 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:16.134587 (+ 1691us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.6.37.62:42733: Server oryx/127.6.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
W20260924 17:34:16.134744 15638 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:16.130247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:51321 (local address 127.6.37.62:42733)
0924 17:34:16.130322 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.130324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.130396 (+ 72us) server_negotiation.cc:407] Connection header received
0924 17:34:16.130439 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.130440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.130450 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.130539 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.130826 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.131441 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.132130 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.132339 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.132394 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.134678 (+ 2284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.6.37.2:51321: BlockingRecv error: recv got EOF from 127.6.37.2:51321 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:34:16.167264 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15159
I20260924 17:34:16.172429 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15312
I20260924 17:34:16.177026 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15446
I20260924 17:34:16.181258 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15087
2026-09-24T17:34:16Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17461 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-24T17:34:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:34:16Z Disabled control of system clock
I20260924 17:34:16.209089 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46587
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:46587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260924 17:34:16.291174 15643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:16.291389 15643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:16.291411 15643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:16.292618 15643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:34:16.292665 15643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:16.292677 15643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:16.292727 15643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:34:16.292745 15643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:34:16.294184 15643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:46587
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:16.294386 15643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:16.294618 15643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:16.299278 15651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.299427 15643 server_base.cc:1034] running on GCE node
W20260924 17:34:16.299283 15649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.299345 15648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.299784 15643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:16.300104 15643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:16.301278 15643 hybrid_clock.cc:648] HybridClock initialized: now 1790271256301266 us; error 29 us; skew 500 ppm
I20260924 17:34:16.302704 15643 webserver.cc:460] Webserver started at http://127.6.37.62:32973/ using document root <none> and password file <none>
I20260924 17:34:16.303038 15643 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:16.303117 15643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:16.303319 15643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:16.304425 15643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "0a4f6ff654a1f6c023643b3f9236fa3f"
server_key_iv: "7764c82797fec6a8f44fe61a46790d77"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.304828 15643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "0a4f6ff654a1f6c023643b3f9236fa3f"
server_key_iv: "7764c82797fec6a8f44fe61a46790d77"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.306486 15643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:34:16.307348 15657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.307556 15643 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.307658 15643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "0a4f6ff654a1f6c023643b3f9236fa3f"
server_key_iv: "7764c82797fec6a8f44fe61a46790d77"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.307735 15643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:16.326706 15643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:16.327090 15643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:16.327258 15643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:16.331656 15643 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:46587
I20260924 17:34:16.331691 15710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:46587 every 8 connection(s)
I20260924 17:34:16.332050 15643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:34:16.332723 15711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:16.333549 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15643
I20260924 17:34:16.333663 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:34:16.333918 6292 external_mini_cluster.cc:1428] Setting key 206545dc7e8bdcea094e1115b81cd015
I20260924 17:34:16.336318 15711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77: Bootstrap starting.
I20260924 17:34:16.337037 15711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:16.337327 15711 log.cc:824] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:16.338053 15711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77: No bootstrap required, opened a new log
I20260924 17:34:16.339888 15711 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46587 } }
I20260924 17:34:16.340082 15711 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:16.340119 15711 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fad4cf350ed4e8ea6091c5adbb7fb77, State: Initialized, Role: FOLLOWER
I20260924 17:34:16.340270 15711 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46587 } }
I20260924 17:34:16.340332 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.334502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46520 (local address 127.6.37.62:46587)
0924 17:34:16.334733 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.334743 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.334777 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:34:16.335447 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.335458 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.335557 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.335710 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.335903 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.337239 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.338008 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.338599 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.338725 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.339342 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:16.339346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:16.339346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:16.339561 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:16.339604 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:16.339620 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:16.339687 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:16.339749 (+ 62us) server_negotiation.cc:299] Negotiation successful
0924 17:34:16.339830 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":96,"threads_started":1}
I20260924 17:34:16.340361 15711 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:34:16.340399 15711 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:34:16.340438 15711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:16.341122 15711 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46587 } }
I20260924 17:34:16.341223 15711 leader_election.cc:302] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fad4cf350ed4e8ea6091c5adbb7fb77; no voters:
I20260924 17:34:16.341341 15711 leader_election.cc:288] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:34:16.341398 15716 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:34:16.341604 15716 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [term 1 LEADER]: Becoming Leader. State: Replica: 9fad4cf350ed4e8ea6091c5adbb7fb77, State: Running, Role: LEADER
I20260924 17:34:16.341629 15711 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:34:16.341696 15716 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46587 } }
I20260924 17:34:16.342109 15718 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fad4cf350ed4e8ea6091c5adbb7fb77. Latest consensus state: current_term: 1 leader_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46587 } } }
I20260924 17:34:16.342532 15718 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:16.342765 15727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:34:16.342774 15717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fad4cf350ed4e8ea6091c5adbb7fb77" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46587 } } }
I20260924 17:34:16.342928 15717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77 [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:16.343353 15727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:34:16.344870 15727 catalog_manager.cc:1347] Generated new cluster ID: 6c78124b8a634823ac8dc6e81ae77155
I20260924 17:34:16.344928 15727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:34:16.360677 15727 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:34:16.361364 15727 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:34:16.367374 15727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fad4cf350ed4e8ea6091c5adbb7fb77: Generated new TSK 0
I20260924 17:34:16.367586 15727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:34:16.372591 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46587
--builtin_ntp_servers=127.6.37.20:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260924 17:34:16.454164 15735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:16.454392 15735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:16.454428 15735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:16.455650 15735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:16.455710 15735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:16.455752 15735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:34:16.457084 15735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:16.457334 15735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:16.457623 15735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:16.463433 15740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.463442 15741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.463821 15735 server_base.cc:1034] running on GCE node
W20260924 17:34:16.463454 15743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.464092 15735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:16.464363 15735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:16.465554 15735 hybrid_clock.cc:648] HybridClock initialized: now 1790271256465538 us; error 28 us; skew 500 ppm
I20260924 17:34:16.467154 15735 webserver.cc:460] Webserver started at http://127.6.37.1:38431/ using document root <none> and password file <none>
I20260924 17:34:16.467438 15735 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:16.467512 15735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:16.467639 15735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:16.469039 15735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "0395ba40c3a14168bae12718ad85838a"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "239d07c8792e6a0ae7e928d6cbad25ee"
server_key_iv: "1bc8cea46be01bdbed7a0b31cf8d4d21"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.469426 15735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "0395ba40c3a14168bae12718ad85838a"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "239d07c8792e6a0ae7e928d6cbad25ee"
server_key_iv: "1bc8cea46be01bdbed7a0b31cf8d4d21"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.471153 15735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260924 17:34:16.471982 15749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.472213 15735 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:34:16.472325 15735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "0395ba40c3a14168bae12718ad85838a"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "239d07c8792e6a0ae7e928d6cbad25ee"
server_key_iv: "1bc8cea46be01bdbed7a0b31cf8d4d21"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.472400 15735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:16.484282 15735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:16.484572 15735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:16.484711 15735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:16.484936 15735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:16.485251 15735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:16.485283 15735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.485306 15735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:16.485351 15735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.490991 15735 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:34521
I20260924 17:34:16.491074 15863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:34521 every 8 connection(s)
I20260924 17:34:16.491370 15735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:34:16.496556 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.492104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:50679 (local address 127.6.37.62:46587)
0924 17:34:16.492145 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.492147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.492371 (+ 224us) server_negotiation.cc:407] Connection header received
0924 17:34:16.492838 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.492839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.492849 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.492903 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.493540 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.494046 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.495057 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.495252 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.495307 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.496290 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:16.496291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:16.496291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:16.496296 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:16.496309 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:16.496313 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:16.496357 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:16.496447 (+ 90us) server_negotiation.cc:299] Negotiation successful
0924 17:34:16.496478 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:34:16.496775 15866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.492080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46587 (local address 127.6.37.1:50679)
0924 17:34:16.492244 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:16.492278 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:16.492757 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:16.492962 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:16.492965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:16.492973 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:16.493448 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.493451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.494129 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.494129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.494978 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.494981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.495324 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.495325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.495434 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.496149 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:34:16.496149 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:16.496181 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:34:16.496206 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:16.496371 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:16.496376 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:16.496379 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:34:16.496440 (+ 61us) client_negotiation.cc:240] Negotiation successful
0924 17:34:16.496531 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":75,"threads_started":1}
I20260924 17:34:16.497366 15864 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46587
I20260924 17:34:16.497481 15864 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:16.497678 15864 heartbeater.cc:511] Master 127.6.37.62:46587 requested a full tablet report, sending...
I20260924 17:34:16.497745 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15735
I20260924 17:34:16.497848 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:34:16.498076 6292 external_mini_cluster.cc:1428] Setting key 09b72de253044020cdc302fce1870fc4
I20260924 17:34:16.498337 15674 ts_manager.cc:194] Registered new tserver with Master: 0395ba40c3a14168bae12718ad85838a (127.6.37.1:34521)
I20260924 17:34:16.499147 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46587
--builtin_ntp_servers=127.6.37.20:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260924 17:34:16.499131 15674 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.1:50679
W20260924 17:34:16.580796 15867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:16.580982 15867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:16.581003 15867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:16.582086 15867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:16.582121 15867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:16.582145 15867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:34:16.583447 15867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:16.583634 15867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:16.583866 15867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:16.588827 15872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.588855 15867 server_base.cc:1034] running on GCE node
W20260924 17:34:16.588824 15873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.588864 15875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.589277 15867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:16.589543 15867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:16.590736 15867 hybrid_clock.cc:648] HybridClock initialized: now 1790271256590720 us; error 26 us; skew 500 ppm
I20260924 17:34:16.591989 15867 webserver.cc:460] Webserver started at http://127.6.37.2:35003/ using document root <none> and password file <none>
I20260924 17:34:16.592228 15867 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:16.592294 15867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:16.592438 15867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:16.593477 15867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "c9e015b972a24819bedaee4dacb0870e"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "0325022498ad8294e74ad4b43fbd2a37"
server_key_iv: "867ff4e257229ea469a2edfef77cef3a"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.593835 15867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "c9e015b972a24819bedaee4dacb0870e"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "0325022498ad8294e74ad4b43fbd2a37"
server_key_iv: "867ff4e257229ea469a2edfef77cef3a"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.595556 15867 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260924 17:34:16.596280 15881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.596427 15867 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:34:16.596532 15867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "c9e015b972a24819bedaee4dacb0870e"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "0325022498ad8294e74ad4b43fbd2a37"
server_key_iv: "867ff4e257229ea469a2edfef77cef3a"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.596622 15867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:16.604329 15867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:16.604598 15867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:16.604728 15867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:16.604947 15867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:16.605247 15867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:16.605297 15867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.605335 15867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:16.605362 15867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.611037 15867 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:36757
I20260924 17:34:16.611122 15997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:36757 every 8 connection(s)
I20260924 17:34:16.611397 15867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:34:16.613788 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 15867
I20260924 17:34:16.613890 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:34:16.614073 6292 external_mini_cluster.cc:1428] Setting key 290f280eb287a8becd60fe9e1597001d
I20260924 17:34:16.615094 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46587
--builtin_ntp_servers=127.6.37.20:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260924 17:34:16.617208 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.612089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:59361 (local address 127.6.37.62:46587)
0924 17:34:16.612153 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.612155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.612392 (+ 237us) server_negotiation.cc:407] Connection header received
0924 17:34:16.612841 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.612842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.612851 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.612908 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.613488 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.614225 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.615629 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.615942 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.616019 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.616901 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:16.616902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:16.616903 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:16.616908 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:16.616926 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:16.616930 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:16.617007 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:16.617070 (+ 63us) server_negotiation.cc:299] Negotiation successful
0924 17:34:16.617104 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:34:16.617321 16000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.612080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46587 (local address 127.6.37.2:59361)
0924 17:34:16.612270 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:16.612308 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:16.612761 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:16.612957 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:16.612960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:16.612968 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:16.613419 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.613423 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.614336 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.614337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.615543 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.615546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.616036 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.616037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.616163 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.616756 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:34:16.616756 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:16.616790 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:34:16.616812 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:16.617000 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:16.617003 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:16.617005 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:34:16.617055 (+ 50us) client_negotiation.cc:240] Negotiation successful
0924 17:34:16.617131 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260924 17:34:16.617875 15998 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46587
I20260924 17:34:16.617980 15998 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:16.618180 15998 heartbeater.cc:511] Master 127.6.37.62:46587 requested a full tablet report, sending...
I20260924 17:34:16.618587 15674 ts_manager.cc:194] Registered new tserver with Master: c9e015b972a24819bedaee4dacb0870e (127.6.37.2:36757)
I20260924 17:34:16.619091 15674 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.2:59361
W20260924 17:34:16.698309 16001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:16.698514 16001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:16.698539 16001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:16.699842 16001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:16.699888 16001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:16.699915 16001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:34:16.701258 16001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:46587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:16.701514 16001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:16.701828 16001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:16.706961 16006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.706984 16007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.706998 16009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.707096 16001 server_base.cc:1034] running on GCE node
I20260924 17:34:16.707444 16001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:16.707716 16001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:16.708904 16001 hybrid_clock.cc:648] HybridClock initialized: now 1790271256708871 us; error 40 us; skew 500 ppm
I20260924 17:34:16.710311 16001 webserver.cc:460] Webserver started at http://127.6.37.3:37681/ using document root <none> and password file <none>
I20260924 17:34:16.710556 16001 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:16.710624 16001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:16.710783 16001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:16.711959 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "abdeb90d6d5d4880b5eec94a2398555b"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "eaf73145d2f56bc2a446796eb1b51328"
server_key_iv: "e9b970947b55f26237bcc7d280b1bd2c"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.712323 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "abdeb90d6d5d4880b5eec94a2398555b"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "eaf73145d2f56bc2a446796eb1b51328"
server_key_iv: "e9b970947b55f26237bcc7d280b1bd2c"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.713627 16001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:34:16.714370 16015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.714537 16001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:34:16.714634 16001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "abdeb90d6d5d4880b5eec94a2398555b"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "eaf73145d2f56bc2a446796eb1b51328"
server_key_iv: "e9b970947b55f26237bcc7d280b1bd2c"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.714715 16001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:16.735682 16001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:16.735994 16001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:16.736146 16001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:16.736366 16001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:16.736690 16001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:16.736743 16001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.736784 16001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:16.736811 16001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.743034 16001 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:45099
I20260924 17:34:16.743084 16130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:45099 every 8 connection(s)
I20260924 17:34:16.743427 16001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:34:16.749001 15714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.744157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:40913 (local address 127.6.37.62:46587)
0924 17:34:16.744199 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.744201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.744462 (+ 261us) server_negotiation.cc:407] Connection header received
0924 17:34:16.744993 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.745002 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.745014 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.745062 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.745745 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.746248 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.747322 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.747525 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.747618 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.748675 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:16.748676 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:16.748676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:16.748681 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:16.748692 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:16.748696 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:16.748786 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:16.748882 (+ 96us) server_negotiation.cc:299] Negotiation successful
0924 17:34:16.748911 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:34:16.749215 16133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.744154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:46587 (local address 127.6.37.3:40913)
0924 17:34:16.744345 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:16.744378 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:16.744891 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:16.745147 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:16.745150 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:16.745159 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:16.745651 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.745656 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.746349 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.746351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.747233 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:16.747236 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:16.747626 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:16.747628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:16.747758 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:16.748489 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:34:16.748490 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:16.748534 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:34:16.748563 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:16.748789 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:16.748795 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:16.748798 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:34:16.748869 (+ 71us) client_negotiation.cc:240] Negotiation successful
0924 17:34:16.748977 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":77,"threads_started":1}
I20260924 17:34:16.749769 16131 heartbeater.cc:347] Connected to a master server at 127.6.37.62:46587
I20260924 17:34:16.749845 16131 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:16.750033 16131 heartbeater.cc:511] Master 127.6.37.62:46587 requested a full tablet report, sending...
I20260924 17:34:16.750399 15674 ts_manager.cc:194] Registered new tserver with Master: abdeb90d6d5d4880b5eec94a2398555b (127.6.37.3:45099)
I20260924 17:34:16.750694 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16001
I20260924 17:34:16.750777 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:34:16.750916 15674 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.3:40913
I20260924 17:34:16.751029 6292 external_mini_cluster.cc:1428] Setting key c0dd1b6ff8df41e88e6c53449b9f3902
I20260924 17:34:16.751936 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260924 17:34:16.753650 15714 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:16.753185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.6.37.62:46587)
0924 17:34:16.753236 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.753238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.753371 (+ 133us) server_negotiation.cc:407] Connection header received
0924 17:34:16.753413 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.753413 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.753421 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.753465 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.753595 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46522: BlockingRecv error: recv got EOF from 127.0.0.1:46522 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260924 17:34:16.753701 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15735
I20260924 17:34:16.759857 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15867
I20260924 17:34:16.764081 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16001
I20260924 17:34:16.769336 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 15643
2026-09-24T17:34:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (586 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-24T17:34:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:34:16Z Disabled control of system clock
I20260924 17:34:16.796219 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:37055
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:37055
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260924 17:34:16.875823 16142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:16.876011 16142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:16.876032 16142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:16.877162 16142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:34:16.877202 16142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:16.877215 16142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:16.877254 16142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:34:16.877283 16142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:34:16.878603 16142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:37055
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:37055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:16.878808 16142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:16.879125 16142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:16.883841 16148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.883873 16150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:16.883888 16147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:16.884059 16142 server_base.cc:1034] running on GCE node
I20260924 17:34:16.884301 16142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:16.884600 16142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:16.885769 16142 hybrid_clock.cc:648] HybridClock initialized: now 1790271256885755 us; error 26 us; skew 500 ppm
I20260924 17:34:16.886947 16142 webserver.cc:460] Webserver started at http://127.6.37.62:37879/ using document root <none> and password file <none>
I20260924 17:34:16.887181 16142 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:16.887247 16142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:16.887377 16142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:16.888482 16142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "4958945dfdd4fafd3a89d06ad7769b33"
server_key_iv: "03f61bc91232776b46782950e87868a7"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.888845 16142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "4958945dfdd4fafd3a89d06ad7769b33"
server_key_iv: "03f61bc91232776b46782950e87868a7"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.890149 16142 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:34:16.890919 16156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:16.891114 16142 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:34:16.891212 16142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08"
format_stamp: "Formatted at 2026-09-24 17:34:16 on dist-test-slave-gcz9"
server_key: "4958945dfdd4fafd3a89d06ad7769b33"
server_key_iv: "03f61bc91232776b46782950e87868a7"
server_key_version: "encryptionkey@0"
I20260924 17:34:16.891300 16142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:16.894415 16142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:16.894685 16142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:16.894840 16142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:16.898476 16142 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:37055
I20260924 17:34:16.898509 16209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:37055 every 8 connection(s)
I20260924 17:34:16.898813 16142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:34:16.899480 16210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:16.900276 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16142
I20260924 17:34:16.900379 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:34:16.900578 6292 external_mini_cluster.cc:1428] Setting key 6372be77d7fed0d710a3fa40fd5cb119
I20260924 17:34:16.902383 16210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08: Bootstrap starting.
I20260924 17:34:16.903106 16210 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:16.903421 16210 log.cc:824] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:16.904201 16210 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08: No bootstrap required, opened a new log
I20260924 17:34:16.904703 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:16.901086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39890 (local address 127.6.37.62:37055)
0924 17:34:16.902614 (+ 1528us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:16.902623 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:16.902652 (+ 29us) server_negotiation.cc:407] Connection header received
0924 17:34:16.903283 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:16.903293 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:16.903346 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:16.903501 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:16.904223 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:16.904226 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:16.904227 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:16.904232 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:16.904279 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:16.904294 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:16.904383 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:16.904462 (+ 79us) server_negotiation.cc:299] Negotiation successful
0924 17:34:16.904515 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1457,"thread_start_us":69,"threads_started":1}
I20260924 17:34:16.906303 16210 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37055 } }
I20260924 17:34:16.906430 16210 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:16.906454 16210 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fe90aafcbac446e9fbe2fb4d86bcf08, State: Initialized, Role: FOLLOWER
I20260924 17:34:16.906567 16210 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37055 } }
I20260924 17:34:16.906652 16210 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:34:16.906674 16210 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:34:16.906701 16210 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:16.907243 16210 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37055 } }
I20260924 17:34:16.907327 16210 leader_election.cc:302] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fe90aafcbac446e9fbe2fb4d86bcf08; no voters:
I20260924 17:34:16.907441 16210 leader_election.cc:288] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:34:16.907512 16215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:34:16.907677 16215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [term 1 LEADER]: Becoming Leader. State: Replica: 2fe90aafcbac446e9fbe2fb4d86bcf08, State: Running, Role: LEADER
I20260924 17:34:16.907727 16210 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:34:16.907773 16215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37055 } }
I20260924 17:34:16.908216 16217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fe90aafcbac446e9fbe2fb4d86bcf08. Latest consensus state: current_term: 1 leader_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37055 } } }
I20260924 17:34:16.908221 16216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fe90aafcbac446e9fbe2fb4d86bcf08" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37055 } } }
I20260924 17:34:16.908354 16217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:16.908361 16216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08 [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:16.908833 16224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:34:16.909257 16224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:34:16.910857 16224 catalog_manager.cc:1347] Generated new cluster ID: cc6181aa79bc49669b7e9ce138f11327
I20260924 17:34:16.910977 16224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:34:16.929685 16224 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:34:16.929895 16224 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:34:16.939990 16224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fe90aafcbac446e9fbe2fb4d86bcf08: Generated new TSK 0
I20260924 17:34:16.940209 16224 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:34:16.950397 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37055
--builtin_ntp_servers=127.6.37.20:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260924 17:34:17.030776 16234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:17.031064 16234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:17.031090 16234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:17.032282 16234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:17.032321 16234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:17.032348 16234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:34:17.033701 16234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:17.033960 16234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:17.034260 16234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:17.039134 16240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:17.039144 16239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:17.039348 16234 server_base.cc:1034] running on GCE node
W20260924 17:34:17.039144 16242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:17.039673 16234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:17.039918 16234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:17.041059 16234 hybrid_clock.cc:648] HybridClock initialized: now 1790271257041043 us; error 26 us; skew 500 ppm
I20260924 17:34:17.049254 16234 webserver.cc:460] Webserver started at http://127.6.37.1:43365/ using document root <none> and password file <none>
I20260924 17:34:17.049508 16234 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:17.049569 16234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:17.049744 16234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:17.050832 16234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "de6796df9acc4524a269ea05f8eaae58"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "e5a779cca66eb348b6733ca595f97dce"
server_key_iv: "e536d573731c3576b140b16f71d3bd87"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.051258 16234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "de6796df9acc4524a269ea05f8eaae58"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "e5a779cca66eb348b6733ca595f97dce"
server_key_iv: "e536d573731c3576b140b16f71d3bd87"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.052556 16234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:17.053287 16248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.053467 16234 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:34:17.053567 16234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "de6796df9acc4524a269ea05f8eaae58"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "e5a779cca66eb348b6733ca595f97dce"
server_key_iv: "e536d573731c3576b140b16f71d3bd87"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.053651 16234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:17.057174 16234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:17.057453 16234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:17.057592 16234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:17.057796 16234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:17.058110 16234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:17.058163 16234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.058202 16234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:17.058230 16234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.064054 16234 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:45531
I20260924 17:34:17.064103 16362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:45531 every 8 connection(s)
I20260924 17:34:17.064404 16234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:34:17.065146 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16234
I20260924 17:34:17.065237 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:34:17.065491 6292 external_mini_cluster.cc:1428] Setting key cf8d53e68c4499629c59168fbfd357e4
I20260924 17:34:17.066537 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37055
--builtin_ntp_servers=127.6.37.20:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260924 17:34:17.067955 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:17.065161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:37189 (local address 127.6.37.62:37055)
0924 17:34:17.065241 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:17.065244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:17.065523 (+ 279us) server_negotiation.cc:407] Connection header received
0924 17:34:17.066163 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:17.066163 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:17.066169 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:17.066231 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:17.067669 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:17.067670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:17.067670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:17.067674 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:17.067690 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:17.067694 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:17.067753 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:17.067836 (+ 83us) server_negotiation.cc:299] Negotiation successful
0924 17:34:17.067847 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260924 17:34:17.068153 16365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:17.065132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37055 (local address 127.6.37.1:37189)
0924 17:34:17.065372 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:17.065421 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:17.066062 (+ 641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:17.066320 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:17.066324 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:17.066334 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:17.067501 (+ 1167us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:34:17.067502 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:17.067540 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:34:17.067577 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:17.067773 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:17.067777 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:17.067780 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:34:17.067847 (+ 67us) client_negotiation.cc:240] Negotiation successful
0924 17:34:17.067919 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":111,"threads_started":1}
I20260924 17:34:17.068621 16363 heartbeater.cc:347] Connected to a master server at 127.6.37.62:37055
I20260924 17:34:17.068696 16363 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:17.068868 16363 heartbeater.cc:511] Master 127.6.37.62:37055 requested a full tablet report, sending...
I20260924 17:34:17.069407 16173 ts_manager.cc:194] Registered new tserver with Master: de6796df9acc4524a269ea05f8eaae58 (127.6.37.1:45531)
W20260924 17:34:17.147289 16366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:17.147521 16366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:17.147558 16366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:17.148720 16366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:17.148782 16366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:17.148824 16366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:34:17.150411 16366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:17.150671 16366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:17.151062 16366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:17.156057 16371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:17.156071 16372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:17.156311 16366 server_base.cc:1034] running on GCE node
W20260924 17:34:17.156080 16374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:17.156577 16366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:17.156773 16366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:17.157909 16366 hybrid_clock.cc:648] HybridClock initialized: now 1790271257157882 us; error 47 us; skew 500 ppm
I20260924 17:34:17.159109 16366 webserver.cc:460] Webserver started at http://127.6.37.2:35225/ using document root <none> and password file <none>
I20260924 17:34:17.159296 16366 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:17.159334 16366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:17.159451 16366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:17.160408 16366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "9544c00a45144bcabe76b533a88058fa"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "1899bfe3ac0546c798612c005a5dbf83"
server_key_iv: "0cbeacd7653b0bbf23b54d2559f9c939"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.160691 16366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "9544c00a45144bcabe76b533a88058fa"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "1899bfe3ac0546c798612c005a5dbf83"
server_key_iv: "0cbeacd7653b0bbf23b54d2559f9c939"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.162027 16366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:34:17.162724 16380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.162972 16366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:17.163069 16366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "9544c00a45144bcabe76b533a88058fa"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "1899bfe3ac0546c798612c005a5dbf83"
server_key_iv: "0cbeacd7653b0bbf23b54d2559f9c939"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.163153 16366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:17.166364 16366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:17.166623 16366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:17.166764 16366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:17.166996 16366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:17.167290 16366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:17.167343 16366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.167389 16366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:17.167418 16366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.173610 16366 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:42765
I20260924 17:34:17.173655 16494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:42765 every 8 connection(s)
I20260924 17:34:17.173955 16366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:34:17.177026 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:17.174698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41039 (local address 127.6.37.62:37055)
0924 17:34:17.174785 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:17.174787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:17.175096 (+ 309us) server_negotiation.cc:407] Connection header received
0924 17:34:17.175631 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:17.175632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:17.175638 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:17.175697 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:17.176819 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:17.176820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:17.176820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:17.176825 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:17.176841 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:17.176845 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:17.176901 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:17.176947 (+ 46us) server_negotiation.cc:299] Negotiation successful
0924 17:34:17.176973 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260924 17:34:17.177181 16497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:17.174668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37055 (local address 127.6.37.2:41039)
0924 17:34:17.174996 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:17.175027 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:17.175463 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:17.175769 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:17.175772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:17.175780 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:17.176657 (+ 877us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:34:17.176658 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:17.176684 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:34:17.176709 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:17.176898 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:17.176901 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:17.176903 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:34:17.176953 (+ 50us) client_negotiation.cc:240] Negotiation successful
0924 17:34:17.177008 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":154,"threads_started":1}
I20260924 17:34:17.177692 16495 heartbeater.cc:347] Connected to a master server at 127.6.37.62:37055
I20260924 17:34:17.177803 16495 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:17.177975 16495 heartbeater.cc:511] Master 127.6.37.62:37055 requested a full tablet report, sending...
I20260924 17:34:17.178357 16173 ts_manager.cc:194] Registered new tserver with Master: 9544c00a45144bcabe76b533a88058fa (127.6.37.2:42765)
I20260924 17:34:17.181972 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16366
I20260924 17:34:17.182050 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:34:17.182240 6292 external_mini_cluster.cc:1428] Setting key 32b395c9862f6cedb24b062a707795a9
I20260924 17:34:17.183182 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37055
--builtin_ntp_servers=127.6.37.20:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260924 17:34:17.267359 16498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:17.267575 16498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:17.267609 16498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:17.268757 16498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:17.268819 16498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:17.268862 16498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:34:17.270193 16498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:17.270462 16498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:17.270744 16498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:17.275609 16504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:17.275647 16506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:17.275647 16503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:17.275689 16498 server_base.cc:1034] running on GCE node
I20260924 17:34:17.276106 16498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:17.276335 16498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:17.277504 16498 hybrid_clock.cc:648] HybridClock initialized: now 1790271257277490 us; error 26 us; skew 500 ppm
I20260924 17:34:17.278823 16498 webserver.cc:460] Webserver started at http://127.6.37.3:36449/ using document root <none> and password file <none>
I20260924 17:34:17.279075 16498 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:17.279121 16498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:17.279210 16498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:17.280155 16498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "80591fc459e0420690186e61bf1a5267"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "a2f775680ab44bc8ac452dc95040b562"
server_key_iv: "bb54fec2bd385fc4790848c6a7c08f8e"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.280508 16498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "80591fc459e0420690186e61bf1a5267"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "a2f775680ab44bc8ac452dc95040b562"
server_key_iv: "bb54fec2bd385fc4790848c6a7c08f8e"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.281852 16498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:34:17.282522 16512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.282697 16498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:34:17.282807 16498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "80591fc459e0420690186e61bf1a5267"
format_stamp: "Formatted at 2026-09-24 17:34:17 on dist-test-slave-gcz9"
server_key: "a2f775680ab44bc8ac452dc95040b562"
server_key_iv: "bb54fec2bd385fc4790848c6a7c08f8e"
server_key_version: "encryptionkey@0"
I20260924 17:34:17.282913 16498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:17.286211 16498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:17.286464 16498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:17.286604 16498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:17.286806 16498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:17.287122 16498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:17.287178 16498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.287216 16498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:17.287245 16498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:17.293080 16498 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:37107
I20260924 17:34:17.293125 16626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:37107 every 8 connection(s)
I20260924 17:34:17.293429 16498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:34:17.296512 16213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:17.294120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:47337 (local address 127.6.37.62:37055)
0924 17:34:17.294188 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:17.294190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:17.294409 (+ 219us) server_negotiation.cc:407] Connection header received
0924 17:34:17.294851 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:17.294852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:17.294857 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:17.294992 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:17.296278 (+ 1286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:17.296279 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:17.296279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:34:17.296283 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:17.296304 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:34:17.296309 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:17.296378 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:17.296447 (+ 69us) server_negotiation.cc:299] Negotiation successful
0924 17:34:17.296460 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:34:17.296674 16629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:17.294104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37055 (local address 127.6.37.3:47337)
0924 17:34:17.294282 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:17.294329 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:17.294768 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:17.295059 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:17.295062 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:17.295078 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:17.296040 (+ 962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:34:17.296041 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:17.296068 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:34:17.296096 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:17.296385 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:17.296388 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:17.296390 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:34:17.296442 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:34:17.296487 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260924 17:34:17.297093 16627 heartbeater.cc:347] Connected to a master server at 127.6.37.62:37055
I20260924 17:34:17.297202 16627 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:17.297375 16627 heartbeater.cc:511] Master 127.6.37.62:37055 requested a full tablet report, sending...
I20260924 17:34:17.297781 16173 ts_manager.cc:194] Registered new tserver with Master: 80591fc459e0420690186e61bf1a5267 (127.6.37.3:37107)
I20260924 17:34:17.298056 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16498
I20260924 17:34:17.298148 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:34:17.298333 6292 external_mini_cluster.cc:1428] Setting key 88dd5f42209e61e2866f07e37a6a9f48
I20260924 17:34:17.299180 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260924 17:34:17.301012 16213 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:34:17.300496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39892 (local address 127.6.37.62:37055)
0924 17:34:17.300576 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:17.300578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:17.300664 (+ 86us) server_negotiation.cc:407] Connection header received
0924 17:34:17.300732 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:17.300733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:17.300737 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:17.300780 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:17.300951 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39892: BlockingRecv error: recv got EOF from 127.0.0.1:39892 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260924 17:34:17.301038 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16234
I20260924 17:34:17.307194 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16366
I20260924 17:34:17.311997 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16498
I20260924 17:34:17.316679 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16142
2026-09-24T17:34:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (547 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:34:17 dist-test-slave-gcz9 krb5kdc[16637](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:34:17 dist-test-slave-gcz9 krb5kdc[16637](info): set up 2 sockets
Sep 24 17:34:17 dist-test-slave-gcz9 krb5kdc[16637](info): commencing operation
krb5kdc: starting...
W20260924 17:34:18.416893 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:34:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:34:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:34:18.538444 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42913
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42913
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:18.619154 16650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:18.619352 16650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:18.619374 16650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:18.620434 16650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:34:18.620466 16650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:18.620481 16650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:18.620493 16650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:34:18.620505 16650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:34:18.622206 16650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:18.622469 16650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:18.622701 16650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:18.627682 16656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:18.627696 16655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:18.627660 16658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:18.627766 16650 server_base.cc:1034] running on GCE node
I20260924 17:34:18.628082 16650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:18.628357 16650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:18.629540 16650 hybrid_clock.cc:648] HybridClock initialized: now 1790271258629528 us; error 29 us; skew 500 ppm
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:18.632074 16650 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:34:18.632479 16650 webserver.cc:460] Webserver started at http://127.6.37.62:34899/ using document root <none> and password file <none>
I20260924 17:34:18.632659 16650 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:18.632704 16650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:18.632848 16650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:18.633877 16650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "75e6d99ba30f44f990a726b9a74dac7b"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "6a4d422f0811cbef1b7994d67f49d730"
server_key_iv: "c5162ce62c8dc2bfb284535856a23d3f"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.634192 16650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "75e6d99ba30f44f990a726b9a74dac7b"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "6a4d422f0811cbef1b7994d67f49d730"
server_key_iv: "c5162ce62c8dc2bfb284535856a23d3f"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.635615 16650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:34:18.636397 16666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.636592 16650 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:18.636695 16650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "75e6d99ba30f44f990a726b9a74dac7b"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "6a4d422f0811cbef1b7994d67f49d730"
server_key_iv: "c5162ce62c8dc2bfb284535856a23d3f"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.636821 16650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:18.652894 16650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:18.655295 16650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:18.655411 16650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:18.659543 16650 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:42913
I20260924 17:34:18.659575 16718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:42913 every 8 connection(s)
I20260924 17:34:18.659981 16650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:34:18.660993 16719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:18.663177 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16650
I20260924 17:34:18.663285 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:34:18.663305 16719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b: Bootstrap starting.
I20260924 17:34:18.663482 6292 external_mini_cluster.cc:1428] Setting key 40676805223be1c53153befc5563fd1a
I20260924 17:34:18.664028 16719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:18.664348 16719 log.cc:824] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:18.665071 16719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b: No bootstrap required, opened a new log
I20260924 17:34:18.667279 16719 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e6d99ba30f44f990a726b9a74dac7b" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42913 } }
I20260924 17:34:18.667443 16719 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:18.667472 16719 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e6d99ba30f44f990a726b9a74dac7b, State: Initialized, Role: FOLLOWER
I20260924 17:34:18.667583 16719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e6d99ba30f44f990a726b9a74dac7b" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42913 } }
I20260924 17:34:18.667671 16719 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:34:18.667709 16719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:34:18.667769 16719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:18.668334 16719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e6d99ba30f44f990a726b9a74dac7b" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42913 } }
I20260924 17:34:18.668450 16719 leader_election.cc:302] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75e6d99ba30f44f990a726b9a74dac7b; no voters:
I20260924 17:34:18.668643 16719 leader_election.cc:288] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:34:18.668663 16724 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:34:18.668768 16724 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [term 1 LEADER]: Becoming Leader. State: Replica: 75e6d99ba30f44f990a726b9a74dac7b, State: Running, Role: LEADER
I20260924 17:34:18.668846 16724 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e6d99ba30f44f990a726b9a74dac7b" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42913 } }
I20260924 17:34:18.668895 16719 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:34:18.669149 16724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75e6d99ba30f44f990a726b9a74dac7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e6d99ba30f44f990a726b9a74dac7b" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42913 } } }
I20260924 17:34:18.669219 16724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:18.669349 16724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75e6d99ba30f44f990a726b9a74dac7b. Latest consensus state: current_term: 1 leader_uuid: "75e6d99ba30f44f990a726b9a74dac7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e6d99ba30f44f990a726b9a74dac7b" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42913 } } }
I20260924 17:34:18.669417 16724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b [sys.catalog]: This master's current role is: LEADER
I20260924 17:34:18.669574 16729 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:34:18.670181 16729 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:18.671877 16729 catalog_manager.cc:1347] Generated new cluster ID: 079e3f8982e745b0903fb47bd373cc15
I20260924 17:34:18.671929 16729 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:34:18.675416 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:18.664057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40552 (local address 127.6.37.62:42913)
0924 17:34:18.664264 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:18.664279 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:18.664305 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:34:18.664789 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:18.664797 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:18.664846 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:18.664981 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:18.665738 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.666594 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.667729 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.668199 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.668296 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:18.671930 (+ 3634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:18.671934 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:18.671934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:18.671946 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:18.673761 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:18.674170 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:18.674174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:18.674174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:18.674270 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:18.674508 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:18.674509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:18.674510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:18.674743 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:18.674972 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:18.675076 (+ 104us) server_negotiation.cc:299] Negotiation successful
0924 17:34:18.675214 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":77,"threads_started":1}
I20260924 17:34:18.681543 16729 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:34:18.682098 16729 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:34:18.692900 16729 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b: Generated new TSK 0
I20260924 17:34:18.693120 16729 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:34:18.722430 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42913
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:18.804447 16745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:18.804706 16745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:18.804741 16745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:18.806191 16745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:18.806239 16745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:18.806267 16745 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:34:18.807736 16745 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:18.807930 16745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:18.808120 16745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:18.813011 16752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:18.813005 16751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:18.813203 16745 server_base.cc:1034] running on GCE node
W20260924 17:34:18.813005 16754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:18.813488 16745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:18.813687 16745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:18.814829 16745 hybrid_clock.cc:648] HybridClock initialized: now 1790271258814805 us; error 38 us; skew 500 ppm
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:18.817332 16745 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:34:18.817713 16745 webserver.cc:460] Webserver started at http://127.6.37.1:44165/ using document root <none> and password file <none>
I20260924 17:34:18.817902 16745 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:18.817943 16745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:18.818032 16745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:18.819092 16745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "d1fc8e638976445d95acb469784a8fef"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "4b7e759911e21cf079e29823d401e8ac"
server_key_iv: "9d88914a84ab39baccce1468a538d13e"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.819451 16745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "d1fc8e638976445d95acb469784a8fef"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "4b7e759911e21cf079e29823d401e8ac"
server_key_iv: "9d88914a84ab39baccce1468a538d13e"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.820734 16745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:34:18.821352 16761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.821516 16745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.821591 16745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "d1fc8e638976445d95acb469784a8fef"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "4b7e759911e21cf079e29823d401e8ac"
server_key_iv: "9d88914a84ab39baccce1468a538d13e"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.821645 16745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:18.832660 16745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:18.834605 16745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:18.834710 16745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:18.834960 16745 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:18.835235 16745 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:18.835265 16745 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.835287 16745 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:18.835309 16745 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.840967 16745 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:42689
I20260924 17:34:18.841054 16875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:42689 every 8 connection(s)
I20260924 17:34:18.841337 16745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:18.847709 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16745
I20260924 17:34:18.847816 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:34:18.848009 6292 external_mini_cluster.cc:1428] Setting key 61545fb33bc836da53c8b209fe2bc286
I20260924 17:34:18.850719 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:18.842049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:47405 (local address 127.6.37.62:42913)
0924 17:34:18.842109 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:18.842111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:18.842304 (+ 193us) server_negotiation.cc:407] Connection header received
0924 17:34:18.842842 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:18.842843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:18.842856 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:18.842958 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:18.843827 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.844347 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.845300 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.845514 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.845564 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:18.847658 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:18.847660 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:18.847660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:18.847667 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:18.849190 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:18.849688 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:18.849689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:18.849690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:18.849739 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:18.850022 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:18.850023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:18.850024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:18.850177 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:18.850249 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:18.850504 (+ 255us) server_negotiation.cc:299] Negotiation successful
0924 17:34:18.850599 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:34:18.850733 16878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:18.842054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42913 (local address 127.6.37.1:47405)
0924 17:34:18.842190 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:18.842224 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:18.842736 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:18.843042 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:18.843046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:18.843567 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:18.843748 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:18.843753 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.844421 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.844421 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:18.845233 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:18.845235 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.845585 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.845585 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:18.845683 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:18.846087 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:18.846095 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:18.847549 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:18.849271 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:18.849279 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:18.849281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:18.849612 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:18.849805 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:18.849806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:18.849807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:18.849948 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:18.850258 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:18.850264 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:18.850378 (+ 114us) client_negotiation.cc:769] Sending connection context
0924 17:34:18.850462 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:34:18.850581 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":72,"threads_started":1}
I20260924 17:34:18.851358 16876 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42913
I20260924 17:34:18.851455 16876 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:18.851644 16876 heartbeater.cc:511] Master 127.6.37.62:42913 requested a full tablet report, sending...
I20260924 17:34:18.852111 16683 ts_manager.cc:194] Registered new tserver with Master: d1fc8e638976445d95acb469784a8fef (127.6.37.1:42689)
I20260924 17:34:18.852785 16683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:47405
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:34:18.874008 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42913
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:18.954994 16881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:18.955230 16881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:18.955269 16881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:18.956450 16881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:18.956517 16881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:18.956564 16881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:34:18.958055 16881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:18.958317 16881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:18.958544 16881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:18.963390 16889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:18.963413 16887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:18.963389 16886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:18.963816 16881 server_base.cc:1034] running on GCE node
I20260924 17:34:18.964038 16881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:18.964282 16881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:18.965452 16881 hybrid_clock.cc:648] HybridClock initialized: now 1790271258965415 us; error 50 us; skew 500 ppm
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:18.968109 16881 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:34:18.968595 16881 webserver.cc:460] Webserver started at http://127.6.37.2:39865/ using document root <none> and password file <none>
I20260924 17:34:18.968794 16881 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:18.968842 16881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:18.968935 16881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:18.970052 16881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "f88784bec43a45329670cd3e4a405645"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "379a190e77c167e0ca41145edb9436d6"
server_key_iv: "6b96dfac6641a598fbdf39c11ac5a10c"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.970386 16881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "f88784bec43a45329670cd3e4a405645"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "379a190e77c167e0ca41145edb9436d6"
server_key_iv: "6b96dfac6641a598fbdf39c11ac5a10c"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.971908 16881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:34:18.972575 16897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.972795 16881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:34:18.972872 16881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "f88784bec43a45329670cd3e4a405645"
format_stamp: "Formatted at 2026-09-24 17:34:18 on dist-test-slave-gcz9"
server_key: "379a190e77c167e0ca41145edb9436d6"
server_key_iv: "6b96dfac6641a598fbdf39c11ac5a10c"
server_key_version: "encryptionkey@0"
I20260924 17:34:18.972950 16881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:18.985607 16881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:18.987485 16881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:18.987638 16881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:18.987886 16881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:18.988178 16881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:18.988211 16881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.988232 16881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:18.988277 16881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:18.994177 16881 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:45541
I20260924 17:34:18.994226 17012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:45541 every 8 connection(s)
I20260924 17:34:18.994546 16881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:34:18.998632 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 16881
I20260924 17:34:18.998737 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:34:18.998983 6292 external_mini_cluster.cc:1428] Setting key 1db033245deb4dcae06b3e74f1be1cfc
Sep 24 17:34:18 dist-test-slave-gcz9 krb5kdc[16637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271258, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:19.005084 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:18.995357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:33135 (local address 127.6.37.62:42913)
0924 17:34:18.995399 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:18.995401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:18.995653 (+ 252us) server_negotiation.cc:407] Connection header received
0924 17:34:18.996170 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:18.996172 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:18.996183 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:18.996236 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:18.997142 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.997642 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.998784 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.999187 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.999273 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.001975 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:19.001977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:19.001977 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:19.001984 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:19.003452 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:19.003981 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:19.003982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:19.003983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:19.004046 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:19.004347 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:19.004348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:19.004348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:19.004473 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:19.004574 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.004894 (+ 320us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.004984 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:34:19.005316 17015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:18.995367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42913 (local address 127.6.37.2:33135)
0924 17:34:18.995538 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:18.995571 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:18.996071 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:18.996304 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:18.996314 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:18.996849 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:18.997034 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:18.997039 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.997737 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.997739 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:18.998680 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:18.998683 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:18.999302 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:18.999303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:18.999443 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:18.999981 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:18.999990 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:19.001875 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:19.003575 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:19.003583 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:19.003585 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:19.003875 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:19.004122 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:19.004123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:19.004124 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:19.004251 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:19.004568 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:19.004576 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:19.004733 (+ 157us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.004851 (+ 118us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.005029 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260924 17:34:19.005822 17013 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42913
I20260924 17:34:19.005920 17013 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:19.006134 17013 heartbeater.cc:511] Master 127.6.37.62:42913 requested a full tablet report, sending...
I20260924 17:34:19.006611 16683 ts_manager.cc:194] Registered new tserver with Master: f88784bec43a45329670cd3e4a405645 (127.6.37.2:45541)
I20260924 17:34:19.007192 16683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:33135
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:34:19.025905 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42913
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:34:19.109589 17018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:34:19.109802 17018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:34:19.109828 17018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:34:19.111055 17018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:34:19.111099 17018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:34:19.111127 17018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:34:19.112574 17018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:42913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:34:19.112838 17018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:34:19.113077 17018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:34:19.118221 17023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:19.118224 17026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:34:19.118402 17024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:34:19.118728 17018 server_base.cc:1034] running on GCE node
I20260924 17:34:19.118988 17018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:34:19.119253 17018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:34:19.120393 17018 hybrid_clock.cc:648] HybridClock initialized: now 1790271259120369 us; error 49 us; skew 500 ppm
Sep 24 17:34:19 dist-test-slave-gcz9 krb5kdc[16637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271259, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:34:19.122839 17018 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:34:19.123363 17018 webserver.cc:460] Webserver started at http://127.6.37.3:33395/ using document root <none> and password file <none>
I20260924 17:34:19.123627 17018 fs_manager.cc:359] Metadata directory not provided
I20260924 17:34:19.123685 17018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:34:19.123828 17018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:34:19.125031 17018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "db05da75202e4373969b2bfacf5bc053"
format_stamp: "Formatted at 2026-09-24 17:34:19 on dist-test-slave-gcz9"
server_key: "fff031555fea9ce9087ff350a6a29943"
server_key_iv: "6d7c38165b8715c1ba12ffa9f5b95b64"
server_key_version: "encryptionkey@0"
I20260924 17:34:19.125403 17018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "db05da75202e4373969b2bfacf5bc053"
format_stamp: "Formatted at 2026-09-24 17:34:19 on dist-test-slave-gcz9"
server_key: "fff031555fea9ce9087ff350a6a29943"
server_key_iv: "6d7c38165b8715c1ba12ffa9f5b95b64"
server_key_version: "encryptionkey@0"
I20260924 17:34:19.126782 17018 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:34:19.127601 17033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:19.127791 17018 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:34:19.127887 17018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "db05da75202e4373969b2bfacf5bc053"
format_stamp: "Formatted at 2026-09-24 17:34:19 on dist-test-slave-gcz9"
server_key: "fff031555fea9ce9087ff350a6a29943"
server_key_iv: "6d7c38165b8715c1ba12ffa9f5b95b64"
server_key_version: "encryptionkey@0"
I20260924 17:34:19.127990 17018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:34:19.137305 17018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:34:19.139158 17018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:34:19.139312 17018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:34:19.139529 17018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:34:19.139823 17018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:34:19.139881 17018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:19.139921 17018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:34:19.139947 17018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:34:19.145955 17018 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:42935
I20260924 17:34:19.146015 17147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:42935 every 8 connection(s)
I20260924 17:34:19.146319 17018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:34:19.150617 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 17018
I20260924 17:34:19.150700 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:34:19.150930 6292 external_mini_cluster.cc:1428] Setting key d5da1b7f75c0b6c32255d97a8c88b369
Sep 24 17:34:19 dist-test-slave-gcz9 krb5kdc[16637](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271259, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:34:19.156257 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.147079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:49653 (local address 127.6.37.62:42913)
0924 17:34:19.147149 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.147152 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.147360 (+ 208us) server_negotiation.cc:407] Connection header received
0924 17:34:19.147958 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.147959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.147974 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.148063 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:19.149155 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.149725 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.150979 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.151324 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.151403 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.153710 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:19.153711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:19.153711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:19.153718 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:19.155013 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:19.155421 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:19.155422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:19.155422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:19.155471 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:19.155702 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:19.155702 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:19.155702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:19.155800 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:19.155849 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.156115 (+ 266us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.156177 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:34:19.156487 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.147048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:42913 (local address 127.6.37.3:49653)
0924 17:34:19.147211 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.147259 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:19.147822 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:19.148159 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:19.148164 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:19.148825 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:34:19.149027 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.149032 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.149853 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.149855 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.150850 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.150852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.151416 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.151417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.151583 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.152197 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:34:19.152205 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:34:19.153626 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:34:19.155086 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:19.155092 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:19.155093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:19.155348 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:19.155532 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:34:19.155532 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:34:19.155532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:34:19.155646 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:34:19.155878 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:34:19.155883 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:34:19.156003 (+ 120us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.156092 (+ 89us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.156217 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260924 17:34:19.157006 17148 heartbeater.cc:347] Connected to a master server at 127.6.37.62:42913
I20260924 17:34:19.157111 17148 heartbeater.cc:464] Registering TS with master...
I20260924 17:34:19.157301 17148 heartbeater.cc:511] Master 127.6.37.62:42913 requested a full tablet report, sending...
I20260924 17:34:19.157713 16683 ts_manager.cc:194] Registered new tserver with Master: db05da75202e4373969b2bfacf5bc053 (127.6.37.3:42935)
I20260924 17:34:19.158084 16683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:49653
I20260924 17:34:19.162865 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:34:19.170598 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.164284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.6.37.62:42913)
0924 17:34:19.164322 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.164324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.164406 (+ 82us) server_negotiation.cc:407] Connection header received
0924 17:34:19.164468 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.164469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.164476 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.164523 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:34:19.165129 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.165587 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.166354 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.166529 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.166576 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.167977 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:34:19.167978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:34:19.167978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:34:19.167983 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:34:19.169416 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:19.169751 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:19.169751 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:19.169752 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:19.169799 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:34:19.169984 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:34:19.169985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:34:19.169985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:34:19.170202 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:34:19.170309 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.170474 (+ 165us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.170535 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:34:19.172284 16683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:34:19.173898 16683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:34:19.180999 17160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.176400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32996 (local address 127.6.37.3:42935)
0924 17:34:19.176573 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.176581 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.176593 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:34:19.176763 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.176766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.176783 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.176910 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:34:19.177111 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.178343 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.179744 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.180550 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.180638 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.180704 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.180857 (+ 153us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.180906 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
I20260924 17:34:19.180997 17157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.176316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:42689 (local address 127.0.0.1:59150)
0924 17:34:19.177022 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.177031 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:19.177067 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:19.177399 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:19.177400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:19.177401 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:34:19.177426 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.177427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.178302 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.178303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.179757 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.179759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.180647 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.180647 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.180735 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.180748 (+ 13us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.180827 (+ 79us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.180899 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":85,"thread_start_us":52,"threads_started":1}
I20260924 17:34:19.181383 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.176669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59150 (local address 127.6.37.1:42689)
0924 17:34:19.176819 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.177152 (+ 333us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.177181 (+ 29us) server_negotiation.cc:407] Connection header received
0924 17:34:19.177227 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.177230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.177246 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.177319 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:34:19.177499 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.178201 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.179833 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.180563 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.180638 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.180705 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.181167 (+ 462us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.181288 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260924 17:34:19.181005 17159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.176295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:42935 (local address 127.0.0.1:32996)
0924 17:34:19.176459 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.176514 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:19.176577 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:19.176915 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:19.176918 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:19.176921 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:34:19.176995 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.176998 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.178472 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.178473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.179633 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.179636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.180645 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.180647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.180732 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.180748 (+ 16us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.180826 (+ 78us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.180899 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":50,"thread_start_us":51,"threads_started":1}
I20260924 17:34:19.181988 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.176309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:45541 (local address 127.0.0.1:52942)
0924 17:34:19.176852 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.176879 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:19.176939 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:19.177194 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:19.177195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:19.177198 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:34:19.177242 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.177244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.178608 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.178610 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.179756 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.179759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.181727 (+ 1968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.181728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.181800 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.181804 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.181868 (+ 64us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.181913 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":52,"threads_started":1}
I20260924 17:34:19.182189 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.176522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52942 (local address 127.6.37.2:45541)
0924 17:34:19.176664 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.176668 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.176990 (+ 322us) server_negotiation.cc:407] Connection header received
0924 17:34:19.177039 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.177042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.177060 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.177181 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:34:19.177323 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.178511 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.180745 (+ 2234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.181600 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.181724 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.181787 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.182072 (+ 285us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.182119 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260924 17:34:19.182242 16809 tablet_service.cc:1467] Processing CreateTablet for tablet c8ed3b4427dd4a32a5eebea1177bb003 (DEFAULT_TABLE table=test-table [id=bd75641f44be479098de031e877d8f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:34:19.182420 17082 tablet_service.cc:1467] Processing CreateTablet for tablet c8ed3b4427dd4a32a5eebea1177bb003 (DEFAULT_TABLE table=test-table [id=bd75641f44be479098de031e877d8f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:34:19.182617 16809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8ed3b4427dd4a32a5eebea1177bb003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:19.182706 17082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8ed3b4427dd4a32a5eebea1177bb003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:19.186056 17163 tablet_bootstrap.cc:492] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: Bootstrap starting.
I20260924 17:34:19.186422 16947 tablet_service.cc:1467] Processing CreateTablet for tablet c8ed3b4427dd4a32a5eebea1177bb003 (DEFAULT_TABLE table=test-table [id=bd75641f44be479098de031e877d8f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:34:19.186733 16947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c8ed3b4427dd4a32a5eebea1177bb003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:34:19.186837 17163 tablet_bootstrap.cc:654] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:19.187392 17163 log.cc:824] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:19.187889 17164 tablet_bootstrap.cc:492] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Bootstrap starting.
I20260924 17:34:19.188490 17164 tablet_bootstrap.cc:654] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:19.188997 17164 log.cc:824] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:19.189494 17163 tablet_bootstrap.cc:492] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: No bootstrap required, opened a new log
I20260924 17:34:19.189618 17163 ts_tablet_manager.cc:1397] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260924 17:34:19.189785 17167 tablet_bootstrap.cc:492] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Bootstrap starting.
I20260924 17:34:19.189895 17164 tablet_bootstrap.cc:492] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: No bootstrap required, opened a new log
I20260924 17:34:19.189970 17164 ts_tablet_manager.cc:1397] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:34:19.190390 17167 tablet_bootstrap.cc:654] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Neither blocks nor log segments found. Creating new log.
I20260924 17:34:19.190860 17167 log.cc:824] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Log is configured to *not* fsync() on all Append() calls
I20260924 17:34:19.191572 17167 tablet_bootstrap.cc:492] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: No bootstrap required, opened a new log
I20260924 17:34:19.191651 17167 ts_tablet_manager.cc:1397] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260924 17:34:19.191803 17163 raft_consensus.cc:348] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.191983 17163 raft_consensus.cc:374] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:19.192026 17163 raft_consensus.cc:729] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1fc8e638976445d95acb469784a8fef, State: Initialized, Role: FOLLOWER
I20260924 17:34:19.192039 17164 raft_consensus.cc:348] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.192191 17164 raft_consensus.cc:374] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:19.192191 17163 consensus_queue.cc:260] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.192240 17164 raft_consensus.cc:729] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db05da75202e4373969b2bfacf5bc053, State: Initialized, Role: FOLLOWER
I20260924 17:34:19.192371 17164 consensus_queue.cc:260] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.192559 16876 heartbeater.cc:503] Master 127.6.37.62:42913 was elected leader, sending a full tablet report...
I20260924 17:34:19.192637 17164 ts_tablet_manager.cc:1428] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:34:19.192891 17148 heartbeater.cc:503] Master 127.6.37.62:42913 was elected leader, sending a full tablet report...
I20260924 17:34:19.192521 17163 ts_tablet_manager.cc:1428] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260924 17:34:19.193665 17167 raft_consensus.cc:348] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.193841 17167 raft_consensus.cc:374] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:34:19.193886 17167 raft_consensus.cc:729] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f88784bec43a45329670cd3e4a405645, State: Initialized, Role: FOLLOWER
I20260924 17:34:19.194005 17167 consensus_queue.cc:260] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.194271 17167 ts_tablet_manager.cc:1428] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:34:19.194330 17013 heartbeater.cc:503] Master 127.6.37.62:42913 was elected leader, sending a full tablet report...
W20260924 17:34:19.245187 17014 tablet.cc:2369] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:34:19.324579 17171 raft_consensus.cc:482] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:34:19.324702 17171 raft_consensus.cc:504] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.325119 17171 leader_election.cc:288] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers db05da75202e4373969b2bfacf5bc053 (127.6.37.3:42935), d1fc8e638976445d95acb469784a8fef (127.6.37.1:42689)
I20260924 17:34:19.329244 17160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.325378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:43813 (local address 127.6.37.3:42935)
0924 17:34:19.325439 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.325441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.325601 (+ 160us) server_negotiation.cc:407] Connection header received
0924 17:34:19.325644 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.325645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.325656 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.325707 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:34:19.325943 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.326670 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.328277 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.328844 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.328921 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.328932 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.329131 (+ 199us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.329170 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260924 17:34:19.329244 17162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.325505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:42865 (local address 127.6.37.1:42689)
0924 17:34:19.325564 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.325585 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.325594 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:34:19.325626 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.325626 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.325637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.325700 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:34:19.325900 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.326663 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.328277 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.328844 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.328921 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.328932 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.329131 (+ 199us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.329170 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 17:34:19.329263 17015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.325313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:42689 (local address 127.6.37.2:42865)
0924 17:34:19.325382 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.325395 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:19.325490 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:19.325727 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:19.325728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:19.325730 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:34:19.325828 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.325830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.326808 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.326810 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.328182 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.328186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.328951 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.328953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.329046 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.329048 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.329111 (+ 63us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.329169 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":105}
I20260924 17:34:19.329269 17172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.325313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:42935 (local address 127.6.37.2:43813)
0924 17:34:19.325527 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.325536 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:34:19.325604 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:34:19.325727 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:34:19.325728 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:34:19.325730 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:34:19.325872 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.325874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.326846 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.326846 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.328182 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:34:19.328186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.328951 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.328953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:34:19.329043 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.329048 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:34:19.329111 (+ 63us) client_negotiation.cc:240] Negotiation successful
0924 17:34:19.329169 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":42,"thread_start_us":95,"threads_started":1}
I20260924 17:34:19.329668 17102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8ed3b4427dd4a32a5eebea1177bb003" candidate_uuid: "f88784bec43a45329670cd3e4a405645" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db05da75202e4373969b2bfacf5bc053" is_pre_election: true
I20260924 17:34:19.329669 16830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8ed3b4427dd4a32a5eebea1177bb003" candidate_uuid: "f88784bec43a45329670cd3e4a405645" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1fc8e638976445d95acb469784a8fef" is_pre_election: true
I20260924 17:34:19.329829 17102 raft_consensus.cc:2454] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88784bec43a45329670cd3e4a405645 in term 0.
I20260924 17:34:19.329851 16830 raft_consensus.cc:2454] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f88784bec43a45329670cd3e4a405645 in term 0.
I20260924 17:34:19.330077 16900 leader_election.cc:302] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db05da75202e4373969b2bfacf5bc053, f88784bec43a45329670cd3e4a405645; no voters:
I20260924 17:34:19.330248 17171 raft_consensus.cc:2781] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:34:19.330295 17171 raft_consensus.cc:482] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:34:19.330312 17171 raft_consensus.cc:3037] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:19.331086 17171 raft_consensus.cc:504] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.331228 17171 leader_election.cc:288] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [CANDIDATE]: Term 1 election: Requested vote from peers db05da75202e4373969b2bfacf5bc053 (127.6.37.3:42935), d1fc8e638976445d95acb469784a8fef (127.6.37.1:42689)
I20260924 17:34:19.331415 16830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8ed3b4427dd4a32a5eebea1177bb003" candidate_uuid: "f88784bec43a45329670cd3e4a405645" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1fc8e638976445d95acb469784a8fef"
I20260924 17:34:19.331377 17102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8ed3b4427dd4a32a5eebea1177bb003" candidate_uuid: "f88784bec43a45329670cd3e4a405645" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db05da75202e4373969b2bfacf5bc053"
I20260924 17:34:19.331502 16830 raft_consensus.cc:3037] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:19.331504 17102 raft_consensus.cc:3037] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:34:19.332245 16830 raft_consensus.cc:2454] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88784bec43a45329670cd3e4a405645 in term 1.
I20260924 17:34:19.332469 16899 leader_election.cc:302] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1fc8e638976445d95acb469784a8fef, f88784bec43a45329670cd3e4a405645; no voters:
I20260924 17:34:19.332485 17102 raft_consensus.cc:2454] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f88784bec43a45329670cd3e4a405645 in term 1.
I20260924 17:34:19.332573 17171 raft_consensus.cc:2781] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:34:19.332732 17171 raft_consensus.cc:686] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 1 LEADER]: Becoming Leader. State: Replica: f88784bec43a45329670cd3e4a405645, State: Running, Role: LEADER
I20260924 17:34:19.332852 17171 consensus_queue.cc:237] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } }
I20260924 17:34:19.333711 16682 catalog_manager.cc:5495] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 reported cstate change: term changed from 0 to 1, leader changed from <none> to f88784bec43a45329670cd3e4a405645 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "f88784bec43a45329670cd3e4a405645" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f88784bec43a45329670cd3e4a405645" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 45541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 } health_report { overall_health: UNKNOWN } } }
W20260924 17:34:19.342067 16877 tablet.cc:2369] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:34:19.360530 17161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.358021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52950 (local address 127.6.37.2:45541)
0924 17:34:19.358087 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0924 17:34:19.358089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:34:19.358099 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:34:19.358144 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:34:19.358144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:34:19.358168 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:34:19.358258 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:34:19.358403 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.358932 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.359689 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:34:19.359906 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:34:19.359984 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:34:19.360191 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:34:19.360294 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:34:19.360382 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0924 17:34:19.360438 (+ 56us) server_negotiation.cc:299] Negotiation successful
0924 17:34:19.360458 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260924 17:34:19.362444 16830 raft_consensus.cc:1261] T c8ed3b4427dd4a32a5eebea1177bb003 P d1fc8e638976445d95acb469784a8fef [term 1 FOLLOWER]: Refusing update from remote peer f88784bec43a45329670cd3e4a405645: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:34:19.362444 17102 raft_consensus.cc:1261] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 1 FOLLOWER]: Refusing update from remote peer f88784bec43a45329670cd3e4a405645: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:34:19.362859 17173 consensus_queue.cc:1035] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1fc8e638976445d95acb469784a8fef" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:34:19.363046 17171 consensus_queue.cc:1035] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db05da75202e4373969b2bfacf5bc053" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 42935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:34:19.365559 17176 mvcc.cc:205] Tried to move back new op lower bound from 7332951078345527296 to 7332951078227828736. Current Snapshot: MvccSnapshot[applied={T|T < 7332951078345527296}]
I20260924 17:34:19.366237 17178 mvcc.cc:205] Tried to move back new op lower bound from 7332951078345527296 to 7332951078227828736. Current Snapshot: MvccSnapshot[applied={T|T < 7332951078345527296}]
I20260924 17:34:19.367957 16682 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:34:19.368037 16682 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:34:19.368904 16682 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75e6d99ba30f44f990a726b9a74dac7b: Sending DeleteTablet for 3 replicas of tablet c8ed3b4427dd4a32a5eebea1177bb003
I20260924 17:34:19.369225 17082 tablet_service.cc:1514] Processing DeleteTablet for tablet c8ed3b4427dd4a32a5eebea1177bb003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:34:19 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:32996
I20260924 17:34:19.369294 16947 tablet_service.cc:1514] Processing DeleteTablet for tablet c8ed3b4427dd4a32a5eebea1177bb003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:34:19 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:52942
I20260924 17:34:19.369304 16809 tablet_service.cc:1514] Processing DeleteTablet for tablet c8ed3b4427dd4a32a5eebea1177bb003 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:34:19 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:59150
I20260924 17:34:19.369454 17186 tablet_replica.cc:330] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: stopping tablet replica
I20260924 17:34:19.369539 17187 tablet_replica.cc:330] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: stopping tablet replica
I20260924 17:34:19.369620 17186 raft_consensus.cc:2229] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:34:19.369699 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16745
I20260924 17:34:19.369721 17186 raft_consensus.cc:2258] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:34:19.370740 17186 ts_tablet_manager.cc:1905] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:34:19.371721 17187 raft_consensus.cc:2229] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:34:19.371840 17187 raft_consensus.cc:2258] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:34:19.372298 17187 ts_tablet_manager.cc:1905] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:34:19.372678 17186 ts_tablet_manager.cc:1918] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:34:19.372741 17186 log.cc:1196] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/c8ed3b4427dd4a32a5eebea1177bb003
I20260924 17:34:19.373020 17186 ts_tablet_manager.cc:1939] T c8ed3b4427dd4a32a5eebea1177bb003 P db05da75202e4373969b2bfacf5bc053: Deleting consensus metadata
I20260924 17:34:19.373427 16669 catalog_manager.cc:4841] TS db05da75202e4373969b2bfacf5bc053 (127.6.37.3:42935): tablet c8ed3b4427dd4a32a5eebea1177bb003 (table test-table [id=bd75641f44be479098de031e877d8f88]) successfully deleted
I20260924 17:34:19.374024 17187 ts_tablet_manager.cc:1918] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:34:19.374095 17187 log.cc:1196] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/c8ed3b4427dd4a32a5eebea1177bb003
I20260924 17:34:19.374330 17187 ts_tablet_manager.cc:1939] T c8ed3b4427dd4a32a5eebea1177bb003 P f88784bec43a45329670cd3e4a405645: Deleting consensus metadata
I20260924 17:34:19.374740 16670 catalog_manager.cc:4841] TS f88784bec43a45329670cd3e4a405645 (127.6.37.2:45541): tablet c8ed3b4427dd4a32a5eebea1177bb003 (table test-table [id=bd75641f44be479098de031e877d8f88]) successfully deleted
W20260924 17:34:19.378530 16668 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:42689 (error 108)
I20260924 17:34:19.378710 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16881
I20260924 17:34:19.379523 17158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:34:19.379405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:42689 (local address 127.0.0.1:59158)
0924 17:34:19.379452 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0924 17:34:19.379484 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:42689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260924 17:34:19.379642 16668 catalog_manager.cc:4584] TS d1fc8e638976445d95acb469784a8fef (127.6.37.1:42689): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c8ed3b4427dd4a32a5eebea1177bb003: Network error: Client connection negotiation failed: client connection to 127.6.37.1:42689: connect: Connection refused (error 111)
I20260924 17:34:19.384600 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 17018
I20260924 17:34:19.389659 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 16650
2026-09-24T17:34:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2073 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:34:19 dist-test-slave-gcz9 krb5kdc[17192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:34:19 dist-test-slave-gcz9 krb5kdc[17192](info): set up 2 sockets
Sep 24 17:34:19 dist-test-slave-gcz9 krb5kdc[17192](info): commencing operation
krb5kdc: starting...
W20260924 17:34:20.536185 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:34:20 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:34:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:34:20Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/rangeradmin_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/rangeradmin_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/rangerlookup_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/rangerlookup_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
I20260924 17:34:20.794720 6292 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskzK0f6g/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/postgres -l logfile start
2026-09-24 17:34:23.467 UTC [17222] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-24 17:34:23.467 UTC [17222] LOG: listening on IPv4 address "127.6.37.20", port 52545
2026-09-24 17:34:23.471 UTC [17222] LOG: listening on Unix socket "/tmp/.s.PGSQL.52545"
2026-09-24 17:34:23.492 UTC [17225] LOG: database system was shut down at 2026-09-24 17:34:21 UTC
2026-09-24 17:34:23.495 UTC [17222] LOG: database system is ready to accept connections
I20260924 17:34:24.477604 6292 mini_postgres.cc:96] Postgres bound to 52545
2026-09-24 17:34:24.484 UTC [17233] FATAL: database "slave" does not exist
127.6.37.20:52545 - accepting connections
I20260924 17:34:24.485456 6292 mini_ranger.cc:161] Starting Ranger...
I20260924 17:34:24.500588 6292 mini_ranger.cc:84] Created miniranger Postgres user
I20260924 17:34:24.984517 6292 mini_ranger.cc:87] Created ranger Postgres database
I20260924 17:34:24.984602 6292 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-admin
2026-09-24 17:34:25,324 [I] DB FLAVOR :POSTGRES
2026-09-24 17:34:25,325 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 17:34:25,325 [I] Checking connection..
2026-09-24 17:34:25,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-24 17:34:25,587 [I] Checking connection passed.
2026-09-24 17:34:25,587 [I] --------- Verifying version history table ---------
2026-09-24 17:34:25,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 17:34:25,853 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 17:34:25,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 17:34:26,102 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 17:34:26,102 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-24 17:34:26,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-24 17:34:26.352 UTC [17298] WARNING: there is no transaction in progress
2026-09-24 17:34:26,359 [I] create_dbversion_catalog.sql file imported successfully
2026-09-24 17:34:26,359 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 17:34:26,609 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-24 17:34:26,609 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 17:34:26,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-24 17:34:26,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-24 17:34:27,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gcz9.c.gcp-upstream.internal','N') ;"
2026-09-24 17:34:27,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 17:34:27,624 [I] Table x_portal_user does not exist in database ranger
2026-09-24 17:34:27,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 17:34:27,889 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-24 17:34:27,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 17:34:28,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 17:34:28,401 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-24 17:34:28,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-24 17:34:29.399 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.415 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.432 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.448 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.463 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.485 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.553 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.563 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.577 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.587 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.597 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.610 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.619 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.625 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.632 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:29.639 UTC [17407] WARNING: there is no transaction in progress
2026-09-24 17:34:30,281 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-24 17:34:30,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-24 17:34:30,522 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-24 17:34:30,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 17:34:30,781 [I] Table x_portal_user already exists in database 'ranger'
2026-09-24 17:34:30,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 17:34:31,026 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-24 17:34:31,026 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 17:34:31,285 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 17:34:31,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gcz9.c.gcp-upstream.internal';"
2026-09-24 17:34:31,822 [I] CORE_DB_SCHEMA import status has been updated
2026-09-24 17:34:31,823 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-24 17:34:32,089 [I] DB_PATCHES have already been applied
I20260924 17:34:32.095429 6292 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-admin:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskzK0f6g/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260924 17:34:32.095489 6292 mini_ranger.cc:193] Using host: 127.6.37.20
I20260924 17:34:32.098485 6292 mini_ranger.cc:227] Ranger admin URL: http://127.6.37.20:59265
Sep 24, 2026 5:34:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 5:34:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 5:34:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp
Sep 24, 2026 5:34:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 24, 2026 5:34:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 24, 2026 5:34:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp].
Sep 24, 2026 5:34:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260924 17:34:33.214361 6292 mini_ranger.cc:160] Time spent starting Ranger: real 8.729s user 0.000s sys 0.009s
Sep 24, 2026 5:34:54 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 24, 2026 5:34:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Sep 24, 2026 5:34:54 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 24, 2026 5:34:54 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 24, 2026 5:34:55 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260924 17:34:55.761830 6292 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/rangerkms_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/rangerkms_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.6.37.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.6.37.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 24 17:34:55 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271295, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260924 17:34:55.847783 6292 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260924 17:34:55.857358 6292 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260924 17:34:56.737859 6292 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260924 17:34:56.737946 6292 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms
I20260924 17:34:56.737968 6292 mini_ranger_kms.cc:227] Using postgres at 127.6.37.20:52545
2026-09-24 17:34:58,338 [I] DB FLAVOR :POSTGRES
2026-09-24 17:34:58,338 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 17:34:58,338 [I] Checking connection
2026-09-24 17:34:58,338 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-24 17:34:58,579 [I] connection success
2026-09-24 17:34:58,579 [I] --------- Verifying Ranger DB tables ---------
2026-09-24 17:34:58,580 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-24 17:34:58,580 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-24 17:34:58,816 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-24 17:34:58,816 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 17:34:58,816 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-24 17:34:58,816 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:52545/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-24 17:34:59,099 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260924 17:34:59.638388 6292 mini_ranger_kms.cc:310] Created kms service
I20260924 17:34:59.867830 6292 mini_ranger_kms.cc:326] Created kudu user
I20260924 17:34:59.912485 6292 mini_ranger_kms.cc:343] Created rangerkms user
Sep 24 17:34:59 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271295, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:00.332675 6292 mini_ranger_kms.cc:384] Added ranger policy
I20260924 17:35:00.332810 6292 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms:/tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260924 17:35:00.332832 6292 mini_ranger_kms.cc:240] Using host: 127.6.37.20
I20260924 17:35:00.337801 6292 mini_ranger_kms.cc:276] Ranger KMS PID: 17590
I20260924 17:35:00.337927 6292 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.6.37.20:59097
Sep 24, 2026 5:35:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 5:35:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 5:35:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 24, 2026 5:35:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 24, 2026 5:35:01 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-kms/ews/webapp].
Sep 24, 2026 5:35:01 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Sep 24 17:35:02 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790271302, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.6.37.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:02.623416 6292 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.776s user 0.012s sys 0.281s
I20260924 17:35:02.623541 6292 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260924 17:35:02.623634 6292 mini_ranger_kms.cc:401] 127.6.37.20:59097/kms/v1/keys
Sep 24 17:35:02 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271302, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.6.37.20@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
Sep 24 17:35:03 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271302, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.6.37.20@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
Sep 24 17:35:05 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:35:05.694446 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:39391
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:39391
--ranger_config_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:59097/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:05.802305 17641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:05.802542 17641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:05.802588 17641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:05.803833 17641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:35:05.803900 17641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:05.803927 17641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:05.803958 17641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:35:05.803983 17641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:35:05.805644 17641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal
--ranger_kms_url=127.6.37.20:59097/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:39391
--ranger_config_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:39391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:05.805985 17641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:05.806236 17641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:05.812980 17647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:05.813052 17646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:05.813125 17641 server_base.cc:1034] running on GCE node
W20260924 17:35:05.813251 17649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:05.813500 17641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:05.813796 17641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:05.814944 17641 hybrid_clock.cc:648] HybridClock initialized: now 1790271305814915 us; error 39 us; skew 500 ppm
Sep 24 17:35:05 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271305, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:05.817588 17641 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:35:05.818127 17641 webserver.cc:460] Webserver started at http://127.6.37.62:35817/ using document root <none> and password file <none>
I20260924 17:35:05.818383 17641 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:05.818439 17641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:05.818578 17641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:05 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271305, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:05.883915 17641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "4749b85612504392914d8dd1d17510b5"
format_stamp: "Formatted at 2026-09-24 17:35:05 on dist-test-slave-gcz9"
server_key: "45aa12fe7ba8f9f993067ff73825a7c6"
server_key_iv: "0c9641dc4693992d8fb3d2a063d7ba72"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:05.884368 17641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "4749b85612504392914d8dd1d17510b5"
format_stamp: "Formatted at 2026-09-24 17:35:05 on dist-test-slave-gcz9"
server_key: "45aa12fe7ba8f9f993067ff73825a7c6"
server_key_iv: "0c9641dc4693992d8fb3d2a063d7ba72"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:05.885951 17641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:35:05.902140 17656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:05.902336 17641 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:05.902453 17641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "4749b85612504392914d8dd1d17510b5"
format_stamp: "Formatted at 2026-09-24 17:35:05 on dist-test-slave-gcz9"
server_key: "45aa12fe7ba8f9f993067ff73825a7c6"
server_key_iv: "0c9641dc4693992d8fb3d2a063d7ba72"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:05.902567 17641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:05.914960 17641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:05.917141 17641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:05.917320 17641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:05.923694 17641 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:39391
I20260924 17:35:05.923723 17708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:39391 every 8 connection(s)
I20260924 17:35:05.924165 17641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:35:05.925031 17709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:05.928622 17709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5: Bootstrap starting.
I20260924 17:35:05.929442 17709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:05.929826 17709 log.cc:824] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:05.930764 17709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5: No bootstrap required, opened a new log
I20260924 17:35:05.931218 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 17641
I20260924 17:35:05.931366 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:35:05.931600 6292 external_mini_cluster.cc:1428] Setting key 6f8038d45182d3d3b92c55dd120f8dec
I20260924 17:35:05.933879 17709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4749b85612504392914d8dd1d17510b5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39391 } }
I20260924 17:35:05.934077 17709 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:05.934125 17709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4749b85612504392914d8dd1d17510b5, State: Initialized, Role: FOLLOWER
I20260924 17:35:05.934285 17709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4749b85612504392914d8dd1d17510b5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39391 } }
I20260924 17:35:05.934386 17709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:35:05.934429 17709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:35:05.934477 17709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:05.935294 17709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4749b85612504392914d8dd1d17510b5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39391 } }
I20260924 17:35:05.935418 17709 leader_election.cc:302] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4749b85612504392914d8dd1d17510b5; no voters:
I20260924 17:35:05.935590 17709 leader_election.cc:288] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:35:05.935703 17715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:35:05.935880 17709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:35:05.935976 17715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4749b85612504392914d8dd1d17510b5, State: Running, Role: LEADER
I20260924 17:35:05.936120 17715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4749b85612504392914d8dd1d17510b5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39391 } }
I20260924 17:35:05.936525 17715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4749b85612504392914d8dd1d17510b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4749b85612504392914d8dd1d17510b5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39391 } } }
I20260924 17:35:05.936681 17715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:05.936875 17715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4749b85612504392914d8dd1d17510b5. Latest consensus state: current_term: 1 leader_uuid: "4749b85612504392914d8dd1d17510b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4749b85612504392914d8dd1d17510b5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 39391 } } }
I20260924 17:35:05.936990 17715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:05.937157 17724 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:35:05.937704 17709 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260924 17:35:05.937731 17724 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:35:05.939412 17733 mvcc.cc:205] Tried to move back new op lower bound from 7332951269125431296 to 7332951269114904576. Current Snapshot: MvccSnapshot[applied={T|T < 7332951269125431296}]
I20260924 17:35:05.939982 17724 catalog_manager.cc:1347] Generated new cluster ID: 50285b5e1a204d819bde227e6534dc27
I20260924 17:35:05.940035 17724 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:35:05 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271305, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:05.945762 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:05.932178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58456 (local address 127.6.37.62:39391)
0924 17:35:05.932375 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:05.932387 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:05.932496 (+ 109us) server_negotiation.cc:407] Connection header received
0924 17:35:05.933871 (+ 1375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:05.933880 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:05.933941 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:05.934293 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:05.934936 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:05.936456 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:05.937741 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:05.938516 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:05.941883 (+ 3367us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:05.941989 (+ 106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:05.941993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:05.941993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:05.942002 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:05.943875 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:05.944252 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:05.944255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:05.944255 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:05.944352 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:05.944540 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:05.944541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:05.944541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:05.944834 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:05.945368 (+ 534us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:05.945435 (+ 67us) server_negotiation.cc:299] Negotiation successful
0924 17:35:05.945545 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":112,"threads_started":1}
I20260924 17:35:05.965633 17724 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:35:05.966584 17724 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:35:05.972865 17724 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5: Generated new TSK 0
I20260924 17:35:05.973143 17724 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:35:06.785418 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:59097/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39391
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:06.883364 17756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:06.883622 17756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:06.883661 17756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:06.884811 17756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:06.884886 17756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:06.884976 17756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:35:06.886435 17756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.6.37.20:59097/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:06.886683 17756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:06.886977 17756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:06.893258 17761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:06.893278 17764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:06.893608 17762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:06.894299 17756 server_base.cc:1034] running on GCE node
I20260924 17:35:06.894523 17756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:06.894774 17756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:06.895936 17756 hybrid_clock.cc:648] HybridClock initialized: now 1790271306895917 us; error 55 us; skew 500 ppm
Sep 24 17:35:06 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271306, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:06.902292 17756 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:35:06.902842 17756 webserver.cc:460] Webserver started at http://127.6.37.1:36043/ using document root <none> and password file <none>
I20260924 17:35:06.903116 17756 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:06.903177 17756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:06.903353 17756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:06 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271306, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:06.917328 17756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "419f5894cc894bf6883a1c5f1ab5721c"
format_stamp: "Formatted at 2026-09-24 17:35:06 on dist-test-slave-gcz9"
server_key: "801f0b83eb0c43d4e3b87eb18e7da8aa"
server_key_iv: "61f3359e62579601b46a2ff398a72a39"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:06.917726 17756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "419f5894cc894bf6883a1c5f1ab5721c"
format_stamp: "Formatted at 2026-09-24 17:35:06 on dist-test-slave-gcz9"
server_key: "801f0b83eb0c43d4e3b87eb18e7da8aa"
server_key_iv: "61f3359e62579601b46a2ff398a72a39"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:06.919265 17756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:35:06.939028 17771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:06.939298 17756 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260924 17:35:06.939482 17756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "419f5894cc894bf6883a1c5f1ab5721c"
format_stamp: "Formatted at 2026-09-24 17:35:06 on dist-test-slave-gcz9"
server_key: "801f0b83eb0c43d4e3b87eb18e7da8aa"
server_key_iv: "61f3359e62579601b46a2ff398a72a39"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:06.939689 17756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:06.957770 17756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:06.961234 17756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:06.961467 17756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:06.961850 17756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:06.962492 17756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:06.962545 17756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:06.962625 17756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:06.962657 17756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:06.975685 17756 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:45957
I20260924 17:35:06.976392 17756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:35:06.977388 17889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:45957 every 8 connection(s)
I20260924 17:35:06.980376 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 17756
I20260924 17:35:06.980489 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:35:06.980729 6292 external_mini_cluster.cc:1428] Setting key aa3521a9c12669fec992549ba4578280
Sep 24 17:35:06 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271306, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:06.990186 17893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:06.978426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:39391 (local address 127.6.37.1:52635)
0924 17:35:06.978716 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:06.978749 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:06.979452 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:06.979886 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:06.979891 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:06.980157 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:06.980639 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:06.980648 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:06.981802 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:06.981804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:06.983301 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:06.983304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:06.983903 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:06.983905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:06.984070 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:06.984812 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:06.984822 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:06.986181 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:06.988435 (+ 2254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:06.988442 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:06.988444 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:06.988740 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:06.988977 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:06.988978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:06.988978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:06.989110 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:06.989438 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:06.989445 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:06.989675 (+ 230us) client_negotiation.cc:769] Sending connection context
0924 17:35:06.989777 (+ 102us) client_negotiation.cc:240] Negotiation successful
0924 17:35:06.989941 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":98,"threads_started":1}
I20260924 17:35:06.991071 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:06.978430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:52635 (local address 127.6.37.62:39391)
0924 17:35:06.978558 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:06.978560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:06.978848 (+ 288us) server_negotiation.cc:407] Connection header received
0924 17:35:06.979644 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:06.979646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:06.979663 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:06.979730 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:06.980818 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:06.981694 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:06.983399 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:06.983778 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:06.984338 (+ 560us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:06.986288 (+ 1950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:06.986290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:06.986290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:06.986306 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:06.988327 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:06.988835 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:06.988836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:06.988837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:06.988902 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:06.989189 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:06.989190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:06.989190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:06.989353 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:06.990773 (+ 1420us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:06.990827 (+ 54us) server_negotiation.cc:299] Negotiation successful
0924 17:35:06.990957 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":67,"threads_started":1}
I20260924 17:35:06.991693 17890 heartbeater.cc:347] Connected to a master server at 127.6.37.62:39391
I20260924 17:35:06.991789 17890 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:06.991997 17890 heartbeater.cc:511] Master 127.6.37.62:39391 requested a full tablet report, sending...
I20260924 17:35:06.992661 17673 ts_manager.cc:194] Registered new tserver with Master: 419f5894cc894bf6883a1c5f1ab5721c (127.6.37.1:45957)
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
I20260924 17:35:06.993652 17673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:52635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:35:07.021683 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:59097/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39391
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:07.134920 17896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:07.135149 17896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:07.135187 17896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:07.136482 17896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:07.136545 17896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:07.136590 17896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:35:07.138214 17896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.6.37.20:59097/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:07.138460 17896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:07.138686 17896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:07.144116 17903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:07.144503 17904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:07.144804 17906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:07.145082 17896 server_base.cc:1034] running on GCE node
I20260924 17:35:07.145548 17896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:07.145838 17896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:07.149115 17896 hybrid_clock.cc:648] HybridClock initialized: now 1790271307149101 us; error 29 us; skew 500 ppm
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:07.152359 17896 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:35:07.152871 17896 webserver.cc:460] Webserver started at http://127.6.37.2:41839/ using document root <none> and password file <none>
I20260924 17:35:07.153119 17896 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:07.153209 17896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:07.153353 17896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:07.165796 17896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "8eff2bbff8b840fb8830e8f1708083b9"
format_stamp: "Formatted at 2026-09-24 17:35:07 on dist-test-slave-gcz9"
server_key: "ed4e7bbe84319f73c94ff3889346ed96"
server_key_iv: "426c9d9d54e2233a93ca36f92da06ef9"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:07.166239 17896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "8eff2bbff8b840fb8830e8f1708083b9"
format_stamp: "Formatted at 2026-09-24 17:35:07 on dist-test-slave-gcz9"
server_key: "ed4e7bbe84319f73c94ff3889346ed96"
server_key_iv: "426c9d9d54e2233a93ca36f92da06ef9"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:07.169756 17896 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:07.187017 17913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:07.187191 17896 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260924 17:35:07.187281 17896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "8eff2bbff8b840fb8830e8f1708083b9"
format_stamp: "Formatted at 2026-09-24 17:35:07 on dist-test-slave-gcz9"
server_key: "ed4e7bbe84319f73c94ff3889346ed96"
server_key_iv: "426c9d9d54e2233a93ca36f92da06ef9"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:07.187383 17896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:07.218772 17896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:07.221256 17896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:07.221410 17896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:07.221639 17896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:07.222051 17896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:07.222097 17896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:07.222128 17896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:07.222146 17896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:07.229360 17896 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:46413
I20260924 17:35:07.229843 17896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:35:07.239058 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 17896
I20260924 17:35:07.239171 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:35:07.239372 6292 external_mini_cluster.cc:1428] Setting key c7645194ae1bb559e365d9a2b96cc7bc
I20260924 17:35:07.231981 18026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:46413 every 8 connection(s)
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:07.257313 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.233959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41667 (local address 127.6.37.62:39391)
0924 17:35:07.234007 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.234009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.239829 (+ 5820us) server_negotiation.cc:407] Connection header received
0924 17:35:07.243884 (+ 4055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.243887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.243902 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.243938 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:07.244987 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.245807 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.247431 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.247750 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.247801 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.253623 (+ 5822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:07.253624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:07.253625 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:07.253633 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:07.255553 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:07.256087 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:07.256088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:07.256088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:07.256155 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:07.256469 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:07.256470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:07.256470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:07.256616 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:07.256678 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.257096 (+ 418us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.257194 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:35:07.258126 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.233670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:39391 (local address 127.6.37.2:41667)
0924 17:35:07.239676 (+ 6006us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.239742 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.243717 (+ 3975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.244150 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.244155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.244463 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:07.244855 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.244864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.245976 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.245977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.247312 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.247316 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.247904 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.247905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.248051 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.251676 (+ 3625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:07.251687 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:07.253489 (+ 1802us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:07.255667 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:07.255674 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:07.255677 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:07.255984 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:07.256231 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:07.256232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:07.256233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:07.256383 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:07.256719 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:07.256726 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:07.256918 (+ 192us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.257705 (+ 787us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.257881 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5944,"thread_start_us":82,"threads_started":1}
I20260924 17:35:07.259351 18027 heartbeater.cc:347] Connected to a master server at 127.6.37.62:39391
I20260924 17:35:07.259459 18027 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:07.259654 18027 heartbeater.cc:511] Master 127.6.37.62:39391 requested a full tablet report, sending...
I20260924 17:35:07.259987 17673 ts_manager.cc:194] Registered new tserver with Master: 8eff2bbff8b840fb8830e8f1708083b9 (127.6.37.2:46413)
I20260924 17:35:07.260488 17673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:41667
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:35:07.286448 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:59097/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39391
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:07.423097 18033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:07.423516 18033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:07.423626 18033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:07.425458 18033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:07.425586 18033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:07.425688 18033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:35:07.427996 18033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.6.37.20:59097/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:39391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:07.428525 18033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:07.428893 18033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:07.435832 18041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:07.436105 18038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:07.436190 18039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:07.436655 18033 server_base.cc:1034] running on GCE node
I20260924 17:35:07.436947 18033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:07.437242 18033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:07.438426 18033 hybrid_clock.cc:648] HybridClock initialized: now 1790271307438403 us; error 34 us; skew 500 ppm
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:07.442859 18033 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:35:07.443397 18033 webserver.cc:460] Webserver started at http://127.6.37.3:46303/ using document root <none> and password file <none>
I20260924 17:35:07.443674 18033 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:07.443734 18033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:07.443856 18033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:07.460593 18033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "449708acd4b441f8bf87bf86b01fb350"
format_stamp: "Formatted at 2026-09-24 17:35:07 on dist-test-slave-gcz9"
server_key: "c0fef03e1a2f5d4cd51873fac246969a"
server_key_iv: "2e86264a81bdba280eefc93f982c161d"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:07.461051 18033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "449708acd4b441f8bf87bf86b01fb350"
format_stamp: "Formatted at 2026-09-24 17:35:07 on dist-test-slave-gcz9"
server_key: "c0fef03e1a2f5d4cd51873fac246969a"
server_key_iv: "2e86264a81bdba280eefc93f982c161d"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:07.463544 18033 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260924 17:35:07.482995 18048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:07.483186 18033 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.001s
I20260924 17:35:07.483274 18033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "449708acd4b441f8bf87bf86b01fb350"
format_stamp: "Formatted at 2026-09-24 17:35:07 on dist-test-slave-gcz9"
server_key: "c0fef03e1a2f5d4cd51873fac246969a"
server_key_iv: "2e86264a81bdba280eefc93f982c161d"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:07.483369 18033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:07.504258 18033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:07.506717 18033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:07.506860 18033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:07.507112 18033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:07.507488 18033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:07.507555 18033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:07.507592 18033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:07.507619 18033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:07.518551 18033 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:43005
I20260924 17:35:07.518608 18161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:43005 every 8 connection(s)
I20260924 17:35:07.519178 18033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:35:07.524323 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 18033
I20260924 17:35:07.524452 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:35:07.524689 6292 external_mini_cluster.cc:1428] Setting key ead4da1430057766ff3259d0e86cbcb0
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:07.531220 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.520028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:40553 (local address 127.6.37.62:39391)
0924 17:35:07.520083 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.520086 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.520398 (+ 312us) server_negotiation.cc:407] Connection header received
0924 17:35:07.521070 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.521071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.521086 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.521159 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:07.521767 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.522298 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.523702 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.524008 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.524088 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.527793 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:07.527795 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:07.527795 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:07.527804 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:07.529339 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:07.529982 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:07.529983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:07.529984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:07.530058 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:07.530383 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:07.530384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:07.530385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:07.530536 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:07.530589 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.531064 (+ 475us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.531153 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260924 17:35:07.531744 18164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.520027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:39391 (local address 127.6.37.3:40553)
0924 17:35:07.520250 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.520293 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.520941 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.521233 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.521237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.521450 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:07.521651 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.521657 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.522418 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.522420 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.523575 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.523579 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.525017 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.525018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.525174 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.525981 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:07.525992 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:07.527681 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:07.529473 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:07.529481 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:07.529483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:07.529863 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:07.530147 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:07.530148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:07.530148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:07.530288 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:07.530647 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:07.530654 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:07.530850 (+ 196us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.531386 (+ 536us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.531559 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
I20260924 17:35:07.532202 18162 heartbeater.cc:347] Connected to a master server at 127.6.37.62:39391
I20260924 17:35:07.532334 18162 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:07.532550 18162 heartbeater.cc:511] Master 127.6.37.62:39391 requested a full tablet report, sending...
I20260924 17:35:07.532974 17673 ts_manager.cc:194] Registered new tserver with Master: 449708acd4b441f8bf87bf86b01fb350 (127.6.37.3:43005)
I20260924 17:35:07.533360 17673 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:40553
I20260924 17:35:07.536659 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:35:07.544589 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.538213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55178 (local address 127.6.37.62:39391)
0924 17:35:07.538256 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.538258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.538447 (+ 189us) server_negotiation.cc:407] Connection header received
0924 17:35:07.538522 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.538523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.538534 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.538584 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:07.539299 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.539776 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.540546 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.540750 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.540833 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.542150 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:07.542151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:07.542151 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:07.542159 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:07.543485 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:07.543843 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:07.543845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:07.543845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:07.543903 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:07.544101 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:07.544102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:07.544102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:07.544210 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:07.544312 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.544416 (+ 104us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.544491 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:35:07.546450 17673 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:35:07.548264 17673 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:35:07.556169 18175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.551086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:43005 (local address 127.0.0.1:54576)
0924 17:35:07.551789 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.551798 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.551882 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.552205 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.552206 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.552209 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:07.552256 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.552258 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.553455 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.553455 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.554778 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.554781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.555858 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.555859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.555930 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.555946 (+ 16us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.556023 (+ 77us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.556076 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"mutex_wait_us":35,"thread_start_us":116,"threads_started":1}
I20260924 17:35:07.556371 18174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.551057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45957 (local address 127.0.0.1:51742)
0924 17:35:07.551538 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.551583 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.551656 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.551955 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.551959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.551961 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:07.552042 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.552044 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.553306 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.553307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.554832 (+ 1525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.554834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.555849 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.555850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.556217 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.556221 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.556270 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.556313 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":34,"thread_start_us":137,"threads_started":1}
I20260924 17:35:07.556475 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.551247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54576 (local address 127.6.37.3:43005)
0924 17:35:07.551458 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.551463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.551852 (+ 389us) server_negotiation.cc:407] Connection header received
0924 17:35:07.552013 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.552016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.552035 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.552091 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:07.552355 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.553375 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.554917 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.555678 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.555750 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.555830 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.556336 (+ 506us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.556376 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":102,"threads_started":1}
I20260924 17:35:07.556643 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.551482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51742 (local address 127.6.37.1:45957)
0924 17:35:07.551621 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.551626 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.551637 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:35:07.551768 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.551770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.551789 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.551868 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:07.552104 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.553214 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.554939 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.555678 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.555750 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.555809 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.556533 (+ 724us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.556577 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":86,"threads_started":1}
I20260924 17:35:07.557298 17822 tablet_service.cc:1467] Processing CreateTablet for tablet a82117acb47d43c493d6cb111b52e534 (DEFAULT_TABLE table=test-table [id=c83eae6ae5e2428f8e88dca5338bc57c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:35:07.557301 18085 tablet_service.cc:1467] Processing CreateTablet for tablet a82117acb47d43c493d6cb111b52e534 (DEFAULT_TABLE table=test-table [id=c83eae6ae5e2428f8e88dca5338bc57c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:35:07.557641 17822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a82117acb47d43c493d6cb111b52e534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:07.557641 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a82117acb47d43c493d6cb111b52e534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:07.558751 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.551349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:46413 (local address 127.0.0.1:59938)
0924 17:35:07.552381 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.552391 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.552430 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.552778 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.552779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.552781 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:07.552835 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.552836 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.554540 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.554541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.556174 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.556177 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.558396 (+ 2219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.558397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.558526 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.558531 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.558602 (+ 71us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.558652 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"thread_start_us":66,"threads_started":1}
I20260924 17:35:07.559231 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.551488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.6.37.2:46413)
0924 17:35:07.552553 (+ 1065us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.552558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.552568 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:35:07.552609 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.552611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.552627 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.552701 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:07.552953 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.554380 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.557228 (+ 2848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.558107 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.558191 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.558351 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.558976 (+ 625us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.559027 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1028,"thread_start_us":96,"threads_started":1}
I20260924 17:35:07.560051 17961 tablet_service.cc:1467] Processing CreateTablet for tablet a82117acb47d43c493d6cb111b52e534 (DEFAULT_TABLE table=test-table [id=c83eae6ae5e2428f8e88dca5338bc57c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:35:07.560544 17961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a82117acb47d43c493d6cb111b52e534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:07.563323 18180 tablet_bootstrap.cc:492] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c: Bootstrap starting.
I20260924 17:35:07.563931 18180 tablet_bootstrap.cc:654] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:07.564229 18180 log.cc:824] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:07.564594 18181 tablet_bootstrap.cc:492] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Bootstrap starting.
I20260924 17:35:07.565241 18180 tablet_bootstrap.cc:492] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c: No bootstrap required, opened a new log
I20260924 17:35:07.565351 18183 tablet_bootstrap.cc:492] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Bootstrap starting.
I20260924 17:35:07.565410 18180 ts_tablet_manager.cc:1397] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:35:07.565881 18181 tablet_bootstrap.cc:654] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:07.566833 18181 log.cc:824] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:07.567795 18183 tablet_bootstrap.cc:654] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:07.568064 18180 raft_consensus.cc:348] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.568223 18180 raft_consensus.cc:374] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:07.568266 18180 raft_consensus.cc:729] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419f5894cc894bf6883a1c5f1ab5721c, State: Initialized, Role: FOLLOWER
I20260924 17:35:07.568380 18180 consensus_queue.cc:260] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.568647 18180 ts_tablet_manager.cc:1428] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:35:07.568652 18183 log.cc:824] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:07.568776 17890 heartbeater.cc:503] Master 127.6.37.62:39391 was elected leader, sending a full tablet report...
I20260924 17:35:07.569962 18183 tablet_bootstrap.cc:492] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: No bootstrap required, opened a new log
I20260924 17:35:07.570050 18183 ts_tablet_manager.cc:1397] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260924 17:35:07.570166 18181 tablet_bootstrap.cc:492] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: No bootstrap required, opened a new log
I20260924 17:35:07.570261 18181 ts_tablet_manager.cc:1397] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260924 17:35:07.571659 18183 raft_consensus.cc:348] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.571803 18183 raft_consensus.cc:374] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:07.571875 18183 raft_consensus.cc:729] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eff2bbff8b840fb8830e8f1708083b9, State: Initialized, Role: FOLLOWER
I20260924 17:35:07.572005 18183 consensus_queue.cc:260] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.572309 18183 ts_tablet_manager.cc:1428] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:35:07.572500 18027 heartbeater.cc:503] Master 127.6.37.62:39391 was elected leader, sending a full tablet report...
I20260924 17:35:07.580904 18181 raft_consensus.cc:348] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.581095 18181 raft_consensus.cc:374] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:07.581130 18181 raft_consensus.cc:729] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 449708acd4b441f8bf87bf86b01fb350, State: Initialized, Role: FOLLOWER
I20260924 17:35:07.581346 18181 consensus_queue.cc:260] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.581684 18181 ts_tablet_manager.cc:1428] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260924 17:35:07.581843 18162 heartbeater.cc:503] Master 127.6.37.62:39391 was elected leader, sending a full tablet report...
I20260924 17:35:07.674600 18187 raft_consensus.cc:482] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:35:07.674772 18187 raft_consensus.cc:504] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.675287 18187 leader_election.cc:288] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 419f5894cc894bf6883a1c5f1ab5721c (127.6.37.1:45957), 449708acd4b441f8bf87bf86b01fb350 (127.6.37.3:43005)
I20260924 17:35:07.679621 18029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.675531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:43005 (local address 127.6.37.2:50503)
0924 17:35:07.675634 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.675646 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.675691 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.676030 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.676031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.676033 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:07.676111 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.676113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.677185 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.677186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.678447 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.678450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.679348 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.679349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.679434 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.679438 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.679496 (+ 58us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.679545 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260924 17:35:07.680132 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.675774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:50503 (local address 127.6.37.3:43005)
0924 17:35:07.675857 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.675859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.675869 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:35:07.675901 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.675902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.675912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.675969 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:07.676195 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.677049 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.678577 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.679226 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.679301 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.679312 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.680023 (+ 711us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.680064 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:35:07.680227 18178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.676828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41841 (local address 127.6.37.1:45957)
0924 17:35:07.676881 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.676883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.676890 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:35:07.676915 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.676916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.676926 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.676973 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:07.677171 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.677879 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.679295 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.679860 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.679901 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.679910 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.680124 (+ 214us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.680158 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:35:07.680456 18189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.676412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45957 (local address 127.6.37.2:41841)
0924 17:35:07.676623 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.676632 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:07.676677 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:07.677020 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:07.677021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:07.677023 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:07.677098 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.677100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.678011 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.678012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.679196 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:07.679198 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.679984 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.679985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:07.680052 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.680055 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:35:07.680332 (+ 277us) client_negotiation.cc:240] Negotiation successful
0924 17:35:07.680371 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":99,"threads_started":1}
I20260924 17:35:07.680405 18116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a82117acb47d43c493d6cb111b52e534" candidate_uuid: "8eff2bbff8b840fb8830e8f1708083b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "449708acd4b441f8bf87bf86b01fb350" is_pre_election: true
I20260924 17:35:07.680567 18116 raft_consensus.cc:2454] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eff2bbff8b840fb8830e8f1708083b9 in term 0.
I20260924 17:35:07.680704 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a82117acb47d43c493d6cb111b52e534" candidate_uuid: "8eff2bbff8b840fb8830e8f1708083b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419f5894cc894bf6883a1c5f1ab5721c" is_pre_election: true
I20260924 17:35:07.680845 17842 raft_consensus.cc:2454] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8eff2bbff8b840fb8830e8f1708083b9 in term 0.
I20260924 17:35:07.681052 17917 leader_election.cc:302] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 419f5894cc894bf6883a1c5f1ab5721c, 8eff2bbff8b840fb8830e8f1708083b9; no voters:
I20260924 17:35:07.681201 18187 raft_consensus.cc:2781] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:35:07.681237 18187 raft_consensus.cc:482] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:35:07.681264 18187 raft_consensus.cc:3037] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:07.682163 18187 raft_consensus.cc:504] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.682286 18187 leader_election.cc:288] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [CANDIDATE]: Term 1 election: Requested vote from peers 419f5894cc894bf6883a1c5f1ab5721c (127.6.37.1:45957), 449708acd4b441f8bf87bf86b01fb350 (127.6.37.3:43005)
I20260924 17:35:07.682473 18116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a82117acb47d43c493d6cb111b52e534" candidate_uuid: "8eff2bbff8b840fb8830e8f1708083b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "449708acd4b441f8bf87bf86b01fb350"
I20260924 17:35:07.682493 17842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a82117acb47d43c493d6cb111b52e534" candidate_uuid: "8eff2bbff8b840fb8830e8f1708083b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419f5894cc894bf6883a1c5f1ab5721c"
I20260924 17:35:07.682559 17842 raft_consensus.cc:3037] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:07.682556 18116 raft_consensus.cc:3037] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:07.683386 17842 raft_consensus.cc:2454] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eff2bbff8b840fb8830e8f1708083b9 in term 1.
I20260924 17:35:07.683549 17917 leader_election.cc:302] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 419f5894cc894bf6883a1c5f1ab5721c, 8eff2bbff8b840fb8830e8f1708083b9; no voters:
I20260924 17:35:07.683619 18187 raft_consensus.cc:2781] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:35:07.683625 18116 raft_consensus.cc:2454] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8eff2bbff8b840fb8830e8f1708083b9 in term 1.
I20260924 17:35:07.683748 18187 raft_consensus.cc:686] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 1 LEADER]: Becoming Leader. State: Replica: 8eff2bbff8b840fb8830e8f1708083b9, State: Running, Role: LEADER
I20260924 17:35:07.683843 18187 consensus_queue.cc:237] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } }
I20260924 17:35:07.684659 17672 catalog_manager.cc:5495] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8eff2bbff8b840fb8830e8f1708083b9 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "8eff2bbff8b840fb8830e8f1708083b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eff2bbff8b840fb8830e8f1708083b9" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46413 } health_report { overall_health: HEALTHY } } }
I20260924 17:35:07.708101 18179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.704470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59946 (local address 127.6.37.2:46413)
0924 17:35:07.704576 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:07.704578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:07.704586 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:35:07.704626 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:07.704627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:07.704652 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:07.704733 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:35:07.704938 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.705702 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.706951 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:07.707264 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:07.707351 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:07.707574 (+ 223us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:35:07.707713 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:35:07.707805 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:07.708005 (+ 200us) server_negotiation.cc:299] Negotiation successful
0924 17:35:07.708023 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260924 17:35:07.711083 18116 raft_consensus.cc:1261] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 1 FOLLOWER]: Refusing update from remote peer 8eff2bbff8b840fb8830e8f1708083b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:35:07.711453 18187 consensus_queue.cc:1035] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "449708acd4b441f8bf87bf86b01fb350" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 43005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:35:07.711609 17842 raft_consensus.cc:1261] T a82117acb47d43c493d6cb111b52e534 P 419f5894cc894bf6883a1c5f1ab5721c [term 1 FOLLOWER]: Refusing update from remote peer 8eff2bbff8b840fb8830e8f1708083b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:35:07.711956 18187 consensus_queue.cc:1035] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "419f5894cc894bf6883a1c5f1ab5721c" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:35:07.722795 18193 mvcc.cc:205] Tried to move back new op lower bound from 7332951276376199168 to 7332951276271595520. Current Snapshot: MvccSnapshot[applied={T|T < 7332951276376199168}]
I20260924 17:35:07.725171 18194 mvcc.cc:205] Tried to move back new op lower bound from 7332951276376199168 to 7332951276271595520. Current Snapshot: MvccSnapshot[applied={T|T < 7332951276376199168}]
I20260924 17:35:07.725981 18196 mvcc.cc:205] Tried to move back new op lower bound from 7332951276376199168 to 7332951276271595520. Current Snapshot: MvccSnapshot[applied={T|T < 7332951276376199168}]
I20260924 17:35:07.729389 17672 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:35:07.729491 17672 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:35:07.730311 17672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4749b85612504392914d8dd1d17510b5: Sending DeleteTablet for 3 replicas of tablet a82117acb47d43c493d6cb111b52e534
I20260924 17:35:07.730904 17822 tablet_service.cc:1514] Processing DeleteTablet for tablet a82117acb47d43c493d6cb111b52e534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:35:07 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:51742
I20260924 17:35:07.731144 17961 tablet_service.cc:1514] Processing DeleteTablet for tablet a82117acb47d43c493d6cb111b52e534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:35:07 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:59938
I20260924 17:35:07.731441 18085 tablet_service.cc:1514] Processing DeleteTablet for tablet a82117acb47d43c493d6cb111b52e534 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:35:07 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:54576
I20260924 17:35:07.731928 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 17756
Sep 24 17:35:07 dist-test-slave-gcz9 krb5kdc[17192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271307, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:07.735057 18205 tablet_replica.cc:330] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: stopping tablet replica
I20260924 17:35:07.735174 18205 raft_consensus.cc:2229] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:35:07.735322 18205 raft_consensus.cc:2258] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:35:07.736682 18205 ts_tablet_manager.cc:1905] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:35:07.737561 18206 tablet_replica.cc:330] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: stopping tablet replica
I20260924 17:35:07.737718 18206 raft_consensus.cc:2229] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:35:07.739001 18206 raft_consensus.cc:2258] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:35:07.739490 18206 ts_tablet_manager.cc:1905] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260924 17:35:07.741850 17660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:45957 (error 108)
I20260924 17:35:07.743121 18205 ts_tablet_manager.cc:1918] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:35:07.743201 18205 log.cc:1196] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/a82117acb47d43c493d6cb111b52e534
I20260924 17:35:07.743368 18206 ts_tablet_manager.cc:1918] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:35:07.743489 18205 ts_tablet_manager.cc:1939] T a82117acb47d43c493d6cb111b52e534 P 8eff2bbff8b840fb8830e8f1708083b9: Deleting consensus metadata
I20260924 17:35:07.743949 17660 catalog_manager.cc:4841] TS 8eff2bbff8b840fb8830e8f1708083b9 (127.6.37.2:46413): tablet a82117acb47d43c493d6cb111b52e534 (table test-table [id=c83eae6ae5e2428f8e88dca5338bc57c]) successfully deleted
I20260924 17:35:07.744095 18206 log.cc:1196] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/a82117acb47d43c493d6cb111b52e534
I20260924 17:35:07.744431 18206 ts_tablet_manager.cc:1939] T a82117acb47d43c493d6cb111b52e534 P 449708acd4b441f8bf87bf86b01fb350: Deleting consensus metadata
I20260924 17:35:07.744870 17659 catalog_manager.cc:4841] TS 449708acd4b441f8bf87bf86b01fb350 (127.6.37.3:43005): tablet a82117acb47d43c493d6cb111b52e534 (table test-table [id=c83eae6ae5e2428f8e88dca5338bc57c]) successfully deleted
I20260924 17:35:07.754351 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 17896
I20260924 17:35:07.755581 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:07.755410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:45957 (local address 127.0.0.1:51748)
0924 17:35:07.755476 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:07.755531 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:45957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260924 17:35:07.756160 17660 catalog_manager.cc:4584] TS 419f5894cc894bf6883a1c5f1ab5721c (127.6.37.1:45957): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a82117acb47d43c493d6cb111b52e534: Network error: Client connection negotiation failed: client connection to 127.6.37.1:45957: connect: Connection refused (error 111)
I20260924 17:35:07.762310 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 18033
I20260924 17:35:07.768190 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 17641
I20260924 17:35:07.774435 6292 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260924 17:35:08.129431 6292 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260924 17:35:08.129552 6292 mini_ranger.cc:66] Stopping Ranger...
I20260924 17:35:08.474184 6292 mini_ranger.cc:68] Stopped Ranger
2026-09-24 17:35:08.474 UTC [17222] LOG: received smart shutdown request
2026-09-24 17:35:08.478 UTC [17222] LOG: background worker "logical replication launcher" (PID 17231) exited with exit code 1
2026-09-24 17:35:08.478 UTC [17226] LOG: shutting down
2026-09-24 17:35:08.641 UTC [17222] LOG: database system is shut down
2026-09-24T17:35:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49363 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:35:08 dist-test-slave-gcz9 krb5kdc[18216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:35:08 dist-test-slave-gcz9 krb5kdc[18216](info): set up 2 sockets
Sep 24 17:35:08 dist-test-slave-gcz9 krb5kdc[18216](info): commencing operation
krb5kdc: starting...
W20260924 17:35:09.793273 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:35:09 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271309, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:35:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:35:09Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/rangeradmin_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/rangeradmin_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/rangerlookup_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/rangerlookup_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
I20260924 17:35:09.953394 6292 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskzK0f6g/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/postgres -l logfile start
2026-09-24 17:35:12.480 UTC [18246] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-24 17:35:12.480 UTC [18246] LOG: listening on IPv4 address "127.6.37.20", port 50011
2026-09-24 17:35:12.484 UTC [18246] LOG: listening on Unix socket "/tmp/.s.PGSQL.50011"
2026-09-24 17:35:12.519 UTC [18249] LOG: database system was shut down at 2026-09-24 17:35:11 UTC
2026-09-24 17:35:12.524 UTC [18246] LOG: database system is ready to accept connections
I20260924 17:35:13.469491 6292 mini_postgres.cc:96] Postgres bound to 50011
2026-09-24 17:35:13.475 UTC [18257] FATAL: database "slave" does not exist
127.6.37.20:50011 - accepting connections
I20260924 17:35:13.476166 6292 mini_ranger.cc:161] Starting Ranger...
I20260924 17:35:13.490832 6292 mini_ranger.cc:84] Created miniranger Postgres user
I20260924 17:35:13.987087 6292 mini_ranger.cc:87] Created ranger Postgres database
I20260924 17:35:13.987156 6292 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-admin
2026-09-24 17:35:14,270 [I] DB FLAVOR :POSTGRES
2026-09-24 17:35:14,270 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 17:35:14,270 [I] Checking connection..
2026-09-24 17:35:14,270 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-24 17:35:14,503 [I] Checking connection passed.
2026-09-24 17:35:14,504 [I] --------- Verifying version history table ---------
2026-09-24 17:35:14,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 17:35:14,747 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 17:35:14,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 17:35:15,007 [I] Table x_db_version_h does not exist in database ranger
2026-09-24 17:35:15,007 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-24 17:35:15,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-24 17:35:15.264 UTC [18321] WARNING: there is no transaction in progress
2026-09-24 17:35:15,271 [I] create_dbversion_catalog.sql file imported successfully
2026-09-24 17:35:15,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-24 17:35:15,531 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-24 17:35:15,531 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 17:35:15,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-24 17:35:15,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-24 17:35:16,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gcz9.c.gcp-upstream.internal','N') ;"
2026-09-24 17:35:16,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 17:35:16,543 [I] Table x_portal_user does not exist in database ranger
2026-09-24 17:35:16,544 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 17:35:16,790 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-24 17:35:16,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 17:35:17,018 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 17:35:17,250 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-24 17:35:17,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-24 17:35:18.235 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.251 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.267 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.283 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.298 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.315 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.371 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.377 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.391 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.401 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.414 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.428 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.438 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.450 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.457 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:18.464 UTC [18429] WARNING: there is no transaction in progress
2026-09-24 17:35:19,101 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-24 17:35:19,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-24 17:35:19,358 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-24 17:35:19,359 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-24 17:35:19,647 [I] Table x_portal_user already exists in database 'ranger'
2026-09-24 17:35:19,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-24 17:35:19,927 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-24 17:35:19,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-24 17:35:20,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-24 17:35:20,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gcz9.c.gcp-upstream.internal';"
2026-09-24 17:35:20,676 [I] CORE_DB_SCHEMA import status has been updated
2026-09-24 17:35:20,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-24 17:35:20,928 [I] DB_PATCHES have already been applied
I20260924 17:35:20.934479 6292 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-admin:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskzK0f6g/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260924 17:35:20.934548 6292 mini_ranger.cc:193] Using host: 127.6.37.20
I20260924 17:35:20.937669 6292 mini_ranger.cc:227] Ranger admin URL: http://127.6.37.20:34443
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-admin/ews/webapp].
Sep 24, 2026 5:35:21 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260924 17:35:22.052268 6292 mini_ranger.cc:160] Time spent starting Ranger: real 8.576s user 0.000s sys 0.009s
Sep 24, 2026 5:35:42 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 24, 2026 5:35:42 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 24, 2026 5:35:42 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 24, 2026 5:35:42 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 24, 2026 5:35:43 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260924 17:35:44.253343 6292 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.6.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.6.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/rangerkms_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.6.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/rangerkms_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.6.37.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.6.37.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.6.37.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/HTTP_127.6.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 24 17:35:44 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271344, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260924 17:35:44.339290 6292 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260924 17:35:44.348817 6292 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260924 17:35:45.189793 6292 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260924 17:35:45.189889 6292 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms
I20260924 17:35:45.189908 6292 mini_ranger_kms.cc:227] Using postgres at 127.6.37.20:50011
2026-09-24 17:35:45,354 [I] DB FLAVOR :POSTGRES
2026-09-24 17:35:45,355 [I] --------- Verifying Ranger DB connection ---------
2026-09-24 17:35:45,355 [I] Checking connection
2026-09-24 17:35:45,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-24 17:35:45,586 [I] connection success
2026-09-24 17:35:45,586 [I] --------- Verifying Ranger DB tables ---------
2026-09-24 17:35:45,587 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-24 17:35:45,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-24 17:35:45,830 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-24 17:35:45,830 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-24 17:35:45,831 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-24 17:35:45,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.6.37.20:50011/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-24 17:35:46,123 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260924 17:35:46.594314 6292 mini_ranger_kms.cc:310] Created kms service
I20260924 17:35:46.775085 6292 mini_ranger_kms.cc:326] Created kudu user
I20260924 17:35:46.821472 6292 mini_ranger_kms.cc:343] Created rangerkms user
Sep 24 17:35:46 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271344, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:47.255961 6292 mini_ranger_kms.cc:384] Added ranger policy
I20260924 17:35:47.256076 6292 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms:/tmp/dist-test-taskzK0f6g/build/release/bin/postgresql.jar:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskzK0f6g/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260924 17:35:47.256094 6292 mini_ranger_kms.cc:240] Using host: 127.6.37.20
I20260924 17:35:47.259613 6292 mini_ranger_kms.cc:276] Ranger KMS PID: 18611
I20260924 17:35:47.259691 6292 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.6.37.20:47865
Sep 24, 2026 5:35:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 24, 2026 5:35:48 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 24, 2026 5:35:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 24, 2026 5:35:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 24, 2026 5:35:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-kms/ews/webapp].
Sep 24, 2026 5:35:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Sep 24 17:35:49 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790271349, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.6.37.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:49.568341 6292 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.229s user 0.010s sys 0.137s
I20260924 17:35:49.568430 6292 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260924 17:35:49.568468 6292 mini_ranger_kms.cc:401] 127.6.37.20:47865/kms/v1/keys
Sep 24 17:35:49 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271349, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.6.37.20@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
Sep 24 17:35:50 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271349, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.6.37.20@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
Sep 24 17:35:52 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:35:52.678476 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34377
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34377
--ranger_config_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:52.767952 18663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:52.768160 18663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:52.768182 18663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:52.769335 18663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:35:52.769379 18663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:52.769394 18663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:52.769407 18663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:35:52.769419 18663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:35:52.771106 18663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
--ranger_kms_url=127.6.37.20:47865/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34377
--ranger_config_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:52.771350 18663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:52.771600 18663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:52.777356 18669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:52.777462 18671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:52.777366 18668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:52.777639 18663 server_base.cc:1034] running on GCE node
I20260924 17:35:52.777894 18663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:52.778216 18663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:52.779371 18663 hybrid_clock.cc:648] HybridClock initialized: now 1790271352779356 us; error 37 us; skew 500 ppm
Sep 24 17:35:52 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271352, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:52.781870 18663 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:35:52.782402 18663 webserver.cc:460] Webserver started at http://127.6.37.62:46751/ using document root <none> and password file <none>
I20260924 17:35:52.782647 18663 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:52.782694 18663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:52.782850 18663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:52 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271352, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:52.838232 18663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "a91801f99c824c568aea0bb72bfc4f29"
format_stamp: "Formatted at 2026-09-24 17:35:52 on dist-test-slave-gcz9"
server_key: "e6b439f50aec79c41eda619959374aaa"
server_key_iv: "957a90644339c05b9966537a46d34649"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:52.838732 18663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "a91801f99c824c568aea0bb72bfc4f29"
format_stamp: "Formatted at 2026-09-24 17:35:52 on dist-test-slave-gcz9"
server_key: "e6b439f50aec79c41eda619959374aaa"
server_key_iv: "957a90644339c05b9966537a46d34649"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:52.840620 18663 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260924 17:35:52.852316 18678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:52.852558 18663 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260924 17:35:52.852663 18663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "a91801f99c824c568aea0bb72bfc4f29"
format_stamp: "Formatted at 2026-09-24 17:35:52 on dist-test-slave-gcz9"
server_key: "e6b439f50aec79c41eda619959374aaa"
server_key_iv: "957a90644339c05b9966537a46d34649"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:52.852777 18663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:52.878618 18663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:52.880623 18663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:52.880793 18663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:52.885792 18663 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34377
I20260924 17:35:52.885831 18732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34377 every 8 connection(s)
I20260924 17:35:52.886200 18663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:35:52.887027 18733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:52.890297 18733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Bootstrap starting.
I20260924 17:35:52.891072 18733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:52.891400 18733 log.cc:824] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:52.892184 18733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: No bootstrap required, opened a new log
I20260924 17:35:52.895052 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 18663
I20260924 17:35:52.895154 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:35:52.895131 18733 raft_consensus.cc:348] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:52.895316 18733 raft_consensus.cc:374] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:52.895350 18733 raft_consensus.cc:729] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91801f99c824c568aea0bb72bfc4f29, State: Initialized, Role: FOLLOWER
I20260924 17:35:52.895364 6292 external_mini_cluster.cc:1428] Setting key cc9e13df20c653ee34f04bb3731d6080
I20260924 17:35:52.895533 18733 consensus_queue.cc:260] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:52.895612 18733 raft_consensus.cc:388] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:35:52.895668 18733 raft_consensus.cc:482] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:35:52.895723 18733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:52.896420 18733 raft_consensus.cc:504] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:52.896543 18733 leader_election.cc:302] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a91801f99c824c568aea0bb72bfc4f29; no voters:
I20260924 17:35:52.896749 18733 leader_election.cc:288] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:35:52.896842 18738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:35:52.897051 18738 raft_consensus.cc:686] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 LEADER]: Becoming Leader. State: Replica: a91801f99c824c568aea0bb72bfc4f29, State: Running, Role: LEADER
I20260924 17:35:52.897096 18733 sys_catalog.cc:564] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:35:52.897231 18738 consensus_queue.cc:237] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:52.897559 18738 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a91801f99c824c568aea0bb72bfc4f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } } }
I20260924 17:35:52.897619 18738 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:52.897739 18738 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a91801f99c824c568aea0bb72bfc4f29. Latest consensus state: current_term: 1 leader_uuid: "a91801f99c824c568aea0bb72bfc4f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } } }
I20260924 17:35:52.897778 18738 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:52.898650 18733 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260924 17:35:52.901378 18744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:35:52.902550 18744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 24 17:35:52 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:52.909615 18737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:52.895844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.6.37.62:34377)
0924 17:35:52.896011 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:52.896020 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:52.896054 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:35:52.896173 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:52.896179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:52.896219 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:52.896349 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:52.897190 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:52.898553 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:52.900484 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:52.902082 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:52.902264 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:52.905367 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:52.905372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:52.905372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:52.905385 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:52.907537 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:52.907915 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:52.907918 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:52.907918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:52.908026 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:52.908240 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:52.908241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:52.908241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:52.908551 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:52.908712 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:52.909228 (+ 516us) server_negotiation.cc:299] Negotiation successful
0924 17:35:52.909357 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260924 17:35:52.911198 18744 catalog_manager.cc:1347] Generated new cluster ID: 9de74803790c4f8eb1f03596421498f1
I20260924 17:35:52.911248 18744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:35:52.939368 18744 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:35:52.940207 18744 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:35:52.942900 18744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Generated new TSK 0
I20260924 17:35:52.943161 18744 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:35:53.683966 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34377
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:53.775051 18779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:53.775240 18779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:53.775262 18779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:53.776413 18779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:53.776453 18779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:53.776479 18779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:35:53.777933 18779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.6.37.20:47865/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:53.778167 18779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:53.778410 18779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:53.783520 18787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:53.783562 18785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:53.783742 18784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:53.783604 18779 server_base.cc:1034] running on GCE node
I20260924 17:35:53.783933 18779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:53.784181 18779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:53.785344 18779 hybrid_clock.cc:648] HybridClock initialized: now 1790271353785328 us; error 31 us; skew 500 ppm
Sep 24 17:35:53 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271353, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:53.787874 18779 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:35:53.788335 18779 webserver.cc:460] Webserver started at http://127.6.37.1:41771/ using document root <none> and password file <none>
I20260924 17:35:53.788563 18779 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:53.788631 18779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:53.788781 18779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:53 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271353, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:53.807221 18779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "702c30bf78684bc18e8d95d707cfdace"
format_stamp: "Formatted at 2026-09-24 17:35:53 on dist-test-slave-gcz9"
server_key: "8a56d711d53658af7a18b36f841ed6dd"
server_key_iv: "31e8454fe653d181a22f89507ece4fa8"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:53.807788 18779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "702c30bf78684bc18e8d95d707cfdace"
format_stamp: "Formatted at 2026-09-24 17:35:53 on dist-test-slave-gcz9"
server_key: "8a56d711d53658af7a18b36f841ed6dd"
server_key_iv: "31e8454fe653d181a22f89507ece4fa8"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:53.811314 18779 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260924 17:35:53.826984 18794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:53.827170 18779 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:53.827327 18779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "702c30bf78684bc18e8d95d707cfdace"
format_stamp: "Formatted at 2026-09-24 17:35:53 on dist-test-slave-gcz9"
server_key: "8a56d711d53658af7a18b36f841ed6dd"
server_key_iv: "31e8454fe653d181a22f89507ece4fa8"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:53.827437 18779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:53.855067 18779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:53.857620 18779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:53.857849 18779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:53.858170 18779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:53.858639 18779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:53.858748 18779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:53.858857 18779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:53.858963 18779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:53.868499 18779 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:36793
I20260924 17:35:53.868762 18910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:36793 every 8 connection(s)
I20260924 17:35:53.868952 18779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:35:53.870241 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 18779
I20260924 17:35:53.870333 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:35:53.870563 6292 external_mini_cluster.cc:1428] Setting key a07cfd3bff1c728550329945ae34fcf7
Sep 24 17:35:53 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271353, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
I20260924 17:35:53.881457 18913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:53.869858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34377 (local address 127.6.37.1:41849)
0924 17:35:53.870049 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:53.870101 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:53.871109 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:53.871563 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:53.871567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:53.871806 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:53.872072 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:53.872079 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:53.873104 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:53.873105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:53.874367 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:53.874370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:53.874933 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:53.874934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:53.875067 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:53.875652 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:53.875662 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:53.877392 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:53.879649 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:53.879656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:53.879659 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:53.879967 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:53.880198 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:53.880199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:53.880199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:53.880369 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:53.880710 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:53.880718 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:53.880899 (+ 181us) client_negotiation.cc:769] Sending connection context
0924 17:35:53.881007 (+ 108us) client_negotiation.cc:240] Negotiation successful
0924 17:35:53.881164 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":83,"threads_started":1}
I20260924 17:35:53.882123 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:53.869883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:41849 (local address 127.6.37.62:34377)
0924 17:35:53.870454 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:53.870456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:53.870466 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:35:53.871360 (+ 894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:53.871361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:53.871374 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:53.871439 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:53.872182 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:53.872995 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:53.874464 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:53.874780 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:53.874865 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:53.877506 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:53.877507 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:53.877508 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:53.877516 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:53.879552 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:53.880056 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:53.880057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:53.880058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:53.880122 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:53.880451 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:53.880452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:53.880452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:53.880607 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:53.880678 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:53.881944 (+ 1266us) server_negotiation.cc:299] Negotiation successful
0924 17:35:53.882038 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":86,"threads_started":1}
I20260924 17:35:53.882519 18911 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34377
I20260924 17:35:53.882618 18911 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:53.882786 18911 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:53.883383 18696 ts_manager.cc:194] Registered new tserver with Master: 702c30bf78684bc18e8d95d707cfdace (127.6.37.1:36793)
I20260924 17:35:53.884138 18696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:41849
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:35:53.902292 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34377
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260924 17:35:54.024827 18917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:54.025096 18917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:54.025133 18917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:54.027006 18917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:54.027062 18917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:54.027107 18917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:35:54.029353 18917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.6.37.20:47865/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:54.029599 18917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:54.029892 18917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:54.036232 18927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.036494 18925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.036751 18924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:54.037874 18917 server_base.cc:1034] running on GCE node
I20260924 17:35:54.038168 18917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:54.038461 18917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:54.039639 18917 hybrid_clock.cc:648] HybridClock initialized: now 1790271354039616 us; error 34 us; skew 500 ppm
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:54.042814 18917 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:35:54.043380 18917 webserver.cc:460] Webserver started at http://127.6.37.2:43357/ using document root <none> and password file <none>
I20260924 17:35:54.043620 18917 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:54.043668 18917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:54.043788 18917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:54.059379 18917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "5439d5b15210430fb528d6327f9a20b7"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "4638d9e9e2288405364ce260cb58b3b4"
server_key_iv: "edc36f45c67fb5c6a63c4d3c0cd536c4"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.059834 18917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "5439d5b15210430fb528d6327f9a20b7"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "4638d9e9e2288405364ce260cb58b3b4"
server_key_iv: "edc36f45c67fb5c6a63c4d3c0cd536c4"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.062440 18917 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260924 17:35:54.089452 18934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.089736 18917 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.001s sys 0.000s
I20260924 17:35:54.089844 18917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "5439d5b15210430fb528d6327f9a20b7"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "4638d9e9e2288405364ce260cb58b3b4"
server_key_iv: "edc36f45c67fb5c6a63c4d3c0cd536c4"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.089957 18917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:54.119499 18917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:54.122109 18917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:54.122257 18917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:54.122493 18917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:54.122946 18917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:54.122996 18917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.123027 18917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:54.123044 18917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.136003 18917 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:41349
I20260924 17:35:54.136802 18917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:35:54.139930 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 18917
I20260924 17:35:54.140038 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:35:54.140201 19049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:41349 every 8 connection(s)
I20260924 17:35:54.140272 6292 external_mini_cluster.cc:1428] Setting key 6c12f3c3c802ae2f1c66c84ae172999e
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
I20260924 17:35:54.163985 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:54.140857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:44897 (local address 127.6.37.62:34377)
0924 17:35:54.140909 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:54.140911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:54.149548 (+ 8637us) server_negotiation.cc:407] Connection header received
0924 17:35:54.150247 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:54.150249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:54.150263 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:54.150336 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:54.151686 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.152494 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.156464 (+ 3970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.156840 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.156896 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:54.160273 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:54.160275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:54.160275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:54.160282 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:54.162147 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:54.162716 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:54.162717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:54.162717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:54.162791 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:54.163167 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:54.163168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:54.163169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:54.163335 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:54.163397 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:54.163770 (+ 373us) server_negotiation.cc:299] Negotiation successful
0924 17:35:54.163863 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:35:54.165697 19052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:54.140878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34377 (local address 127.6.37.2:44897)
0924 17:35:54.149336 (+ 8458us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:54.149400 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:54.150110 (+ 710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:54.150502 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:54.150508 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:54.151049 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:54.151536 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:54.151544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.152636 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.152637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:54.154183 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:54.154194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.157080 (+ 2886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.157081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:54.157238 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:54.158009 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:54.158020 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:54.160162 (+ 2142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:54.162305 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:54.162311 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:54.162314 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:54.162594 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:54.162914 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:54.162915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:54.162916 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:54.163082 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:54.163435 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:54.163441 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:54.163617 (+ 176us) client_negotiation.cc:769] Sending connection context
0924 17:35:54.165281 (+ 1664us) client_negotiation.cc:240] Negotiation successful
0924 17:35:54.165459 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8396,"thread_start_us":153,"threads_started":1}
I20260924 17:35:54.170634 19050 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34377
I20260924 17:35:54.170765 19050 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:54.171003 19050 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:54.171447 18696 ts_manager.cc:194] Registered new tserver with Master: 5439d5b15210430fb528d6327f9a20b7 (127.6.37.2:41349)
I20260924 17:35:54.171959 18696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:44897
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:35:54.184974 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34377
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:54.326611 19055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:54.326988 19055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:54.327065 19055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:54.328768 19055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:54.328817 19055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:54.328853 19055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:35:54.331061 19055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.6.37.20:47865/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:54.331297 19055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:54.331584 19055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:54.337919 19063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.337949 19060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.337989 19061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:54.338749 19055 server_base.cc:1034] running on GCE node
I20260924 17:35:54.338996 19055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:54.339267 19055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:54.340440 19055 hybrid_clock.cc:648] HybridClock initialized: now 1790271354340418 us; error 34 us; skew 500 ppm
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:54.343624 19055 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:35:54.344070 19055 webserver.cc:460] Webserver started at http://127.6.37.3:37937/ using document root <none> and password file <none>
I20260924 17:35:54.344300 19055 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:54.344368 19055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:54.344540 19055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:54.357779 19055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "d5ab6e395e014cbe89d150633eae0be1"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "b89b9c071ccdf8e77eabd25d45aa321c"
server_key_iv: "8537f04ffefff4a215728a464ecaaf5a"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.358177 19055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "d5ab6e395e014cbe89d150633eae0be1"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "b89b9c071ccdf8e77eabd25d45aa321c"
server_key_iv: "8537f04ffefff4a215728a464ecaaf5a"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.359876 19055 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:35:54.381440 19070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.381687 19055 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:54.381795 19055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "d5ab6e395e014cbe89d150633eae0be1"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "b89b9c071ccdf8e77eabd25d45aa321c"
server_key_iv: "8537f04ffefff4a215728a464ecaaf5a"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.381918 19055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:54.402077 19055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:54.404422 19055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:54.404584 19055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:54.404843 19055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:54.405237 19055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:54.405292 19055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.405366 19055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:54.405395 19055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.417691 19055 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:37685
I20260924 17:35:54.418107 19055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:35:54.419198 19184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:37685 every 8 connection(s)
I20260924 17:35:54.425238 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19055
I20260924 17:35:54.425367 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:35:54.425581 6292 external_mini_cluster.cc:1428] Setting key 92b1b62d36e7d2cd5481f8776f801836
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:54.436820 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:54.419837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:53195 (local address 127.6.37.62:34377)
0924 17:35:54.419912 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:54.419915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:54.423141 (+ 3226us) server_negotiation.cc:407] Connection header received
0924 17:35:54.423682 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:54.423683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:54.423697 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:54.423758 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:54.424410 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.424904 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.430052 (+ 5148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.430283 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.430407 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:54.433102 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:54.433104 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:54.433104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:54.433112 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:54.435114 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:54.435619 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:54.435620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:54.435621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:54.435685 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:54.435979 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:54.435980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:54.435981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:54.436112 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:54.436193 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:54.436596 (+ 403us) server_negotiation.cc:299] Negotiation successful
0924 17:35:54.436696 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260924 17:35:54.437726 19187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:54.419812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34377 (local address 127.6.37.3:53195)
0924 17:35:54.423004 (+ 3192us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:54.423043 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:54.423575 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:54.423830 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:54.423834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:54.424056 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:54.424254 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:54.424258 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.428682 (+ 4424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.428684 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:54.429931 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:54.429935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.430418 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.430419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:54.430567 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:54.431231 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:54.431240 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:54.432975 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:54.435249 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:54.435257 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:54.435260 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:54.435524 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:54.435762 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:54.435763 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:54.435763 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:54.435896 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:54.436197 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:54.436204 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:54.436404 (+ 200us) client_negotiation.cc:769] Sending connection context
0924 17:35:54.437262 (+ 858us) client_negotiation.cc:240] Negotiation successful
0924 17:35:54.437467 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3140,"thread_start_us":103,"threads_started":1}
I20260924 17:35:54.438200 19185 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34377
I20260924 17:35:54.438305 19185 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:54.438516 19185 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:54.438911 18696 ts_manager.cc:194] Registered new tserver with Master: d5ab6e395e014cbe89d150633eae0be1 (127.6.37.3:37685)
I20260924 17:35:54.439348 18696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:53195
I20260924 17:35:54.448149 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:35:54.448794 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 18779
I20260924 17:35:54.455732 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 18917
I20260924 17:35:54.462391 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19055
I20260924 17:35:54.469321 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 18663
I20260924 17:35:54.475910 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34377
--webserver_interface=127.6.37.62
--webserver_port=46751
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34377
--ranger_config_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:54.567214 19188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:54.567426 19188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:54.567451 19188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:54.568630 19188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:35:54.568667 19188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:54.568683 19188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:54.568696 19188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:35:54.568709 19188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:35:54.570437 19188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34377
--ranger_config_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=46751
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:54.570626 19188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:54.570791 19188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:54.575963 19193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.575938 19196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:54.576162 19188 server_base.cc:1034] running on GCE node
W20260924 17:35:54.575948 19194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:54.576464 19188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:54.576738 19188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:54.577929 19188 hybrid_clock.cc:648] HybridClock initialized: now 1790271354577901 us; error 39 us; skew 500 ppm
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:54.580615 19188 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:35:54.581089 19188 webserver.cc:460] Webserver started at http://127.6.37.62:46751/ using document root <none> and password file <none>
I20260924 17:35:54.581348 19188 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:54.581405 19188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:54.622442 19188 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:54.623245 19204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.623456 19188 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:35:54.623564 19188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "a91801f99c824c568aea0bb72bfc4f29"
format_stamp: "Formatted at 2026-09-24 17:35:52 on dist-test-slave-gcz9"
server_key: "e6b439f50aec79c41eda619959374aaa"
server_key_iv: "957a90644339c05b9966537a46d34649"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.623939 19188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:54.643913 19188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:54.645527 19188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:54.645696 19188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:54.649937 19188 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34377
I20260924 17:35:54.649974 19256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34377 every 8 connection(s)
I20260924 17:35:54.650346 19188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:35:54.651297 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19188
I20260924 17:35:54.651582 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:36793
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:34377
--webserver_port=41771
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:35:54.651870 19257 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:35:54.652521 19257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Bootstrap starting.
I20260924 17:35:54.662557 19257 log.cc:824] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:54.664923 19257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:35:54.665247 19257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Bootstrap complete.
I20260924 17:35:54.668570 19257 raft_consensus.cc:348] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:54.668882 19257 raft_consensus.cc:729] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91801f99c824c568aea0bb72bfc4f29, State: Initialized, Role: FOLLOWER
I20260924 17:35:54.669042 19257 consensus_queue.cc:260] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:54.669106 19257 raft_consensus.cc:388] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:35:54.669147 19257 raft_consensus.cc:482] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:35:54.669191 19257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 1 FOLLOWER]: Advancing to term 2
I20260924 17:35:54.670490 19257 raft_consensus.cc:504] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:54.670600 19257 leader_election.cc:302] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a91801f99c824c568aea0bb72bfc4f29; no voters:
I20260924 17:35:54.670760 19257 leader_election.cc:288] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 17:35:54.670822 19261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 2 FOLLOWER]: Leader election won for term 2
I20260924 17:35:54.671042 19261 raft_consensus.cc:686] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [term 2 LEADER]: Becoming Leader. State: Replica: a91801f99c824c568aea0bb72bfc4f29, State: Running, Role: LEADER
I20260924 17:35:54.671073 19257 sys_catalog.cc:564] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:35:54.671485 19261 consensus_queue.cc:237] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } }
I20260924 17:35:54.671808 19262 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a91801f99c824c568aea0bb72bfc4f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } } }
I20260924 17:35:54.671818 19263 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a91801f99c824c568aea0bb72bfc4f29. Latest consensus state: current_term: 2 leader_uuid: "a91801f99c824c568aea0bb72bfc4f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a91801f99c824c568aea0bb72bfc4f29" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34377 } } }
I20260924 17:35:54.671968 19262 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:54.671995 19263 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:54.672152 19270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:35:54.672719 19270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:35:54.672906 19270 catalog_manager.cc:1259] Loaded cluster ID: 9de74803790c4f8eb1f03596421498f1
I20260924 17:35:54.672982 19270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:35:54.673081 19257 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260924 17:35:54.677031 19270 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:35:54.677627 19270 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Loaded TSK: 0
I20260924 17:35:54.678016 19270 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 17:35:54.779112 19259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:54.779407 19259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:54.779444 19259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:54.781412 19259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:54.781464 19259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:54.781507 19259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:35:54.783969 19259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:36793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=41771
--tserver_master_addrs=127.6.37.62:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:54.784240 19259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:54.784548 19259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:54.791451 19296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.791785 19298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.792560 19295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:54.793206 19259 server_base.cc:1034] running on GCE node
I20260924 17:35:54.793442 19259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:54.793728 19259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:54.794922 19259 hybrid_clock.cc:648] HybridClock initialized: now 1790271354794903 us; error 29 us; skew 500 ppm
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:54.798389 19259 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:35:54.799024 19259 webserver.cc:460] Webserver started at http://127.6.37.1:41771/ using document root <none> and password file <none>
I20260924 17:35:54.799328 19259 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:54.799418 19259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:54.819041 19259 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260924 17:35:54.820305 19306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.820541 19259 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:54.820654 19259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "702c30bf78684bc18e8d95d707cfdace"
format_stamp: "Formatted at 2026-09-24 17:35:53 on dist-test-slave-gcz9"
server_key: "8a56d711d53658af7a18b36f841ed6dd"
server_key_iv: "31e8454fe653d181a22f89507ece4fa8"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:54.821097 19259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:54.831007 19259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:54.833009 19259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:54.833150 19259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:54.833400 19259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:54.833716 19259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:54.833771 19259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.833814 19259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:54.833840 19259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:54.840399 19259 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:36793
I20260924 17:35:54.840482 19419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:36793 every 8 connection(s)
I20260924 17:35:54.840811 19259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:35:54.849221 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19259
I20260924 17:35:54.849562 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:41349
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:34377
--webserver_port=43357
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:54.854734 19422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:54.841775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34377 (local address 127.6.37.1:41533)
0924 17:35:54.843009 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:54.843060 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:54.843702 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:54.844448 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:54.844453 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:54.844620 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:54.844811 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:54.844815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.846702 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.846705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:54.847642 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:54.847645 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.848276 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.848278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:54.848422 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:54.848938 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:54.848946 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:54.850625 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:54.852636 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:54.852644 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:54.852646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:54.852967 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:54.853299 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:54.853300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:54.853300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:54.853463 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:54.853971 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:54.853977 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:54.854138 (+ 161us) client_negotiation.cc:769] Sending connection context
0924 17:35:54.854271 (+ 133us) client_negotiation.cc:240] Negotiation successful
0924 17:35:54.854447 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1180,"thread_start_us":88,"threads_started":1}
I20260924 17:35:54.855844 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:54.841848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:41533 (local address 127.6.37.62:34377)
0924 17:35:54.843947 (+ 2099us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:54.843957 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:54.843998 (+ 41us) server_negotiation.cc:407] Connection header received
0924 17:35:54.844152 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:54.844159 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:54.844215 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:54.844366 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:54.844948 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.846509 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.847736 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:54.848147 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:54.848296 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:54.850751 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:54.850755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:54.850755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:54.850767 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:54.852528 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:54.853070 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:54.853074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:54.853074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:54.853206 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:54.853549 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:54.853551 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:54.853551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:54.853861 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:54.853942 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:54.855447 (+ 1505us) server_negotiation.cc:299] Negotiation successful
0924 17:35:54.855594 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2038,"thread_start_us":117,"threads_started":1}
I20260924 17:35:54.857012 19420 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34377
I20260924 17:35:54.857124 19420 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:54.857303 19420 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
W20260924 17:35:54.858332 19420 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:34377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 17:35:54.858412 19420 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:54.858484 19420 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:54.858932 19420 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:54.859009 19420 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
W20260924 17:35:54.859324 19420 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:35:54.949242 19424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:54.949621 19424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:54.949721 19424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:54.951522 19424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:54.951624 19424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:54.951705 19424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:35:54.953910 19424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:41349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=43357
--tserver_master_addrs=127.6.37.62:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:54.954285 19424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:54.954617 19424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:54.959692 19429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.959766 19430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:54.960004 19432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:54.960976 19424 server_base.cc:1034] running on GCE node
I20260924 17:35:54.961179 19424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:54.961463 19424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:54.962658 19424 hybrid_clock.cc:648] HybridClock initialized: now 1790271354962646 us; error 27 us; skew 500 ppm
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:54.965235 19424 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:35:54.965678 19424 webserver.cc:460] Webserver started at http://127.6.37.2:43357/ using document root <none> and password file <none>
I20260924 17:35:54.965968 19424 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:54.966085 19424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 17:35:54 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:54.998292 19424 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260924 17:35:55.001220 19440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:55.001430 19424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260924 17:35:55.001518 19424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "5439d5b15210430fb528d6327f9a20b7"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "4638d9e9e2288405364ce260cb58b3b4"
server_key_iv: "edc36f45c67fb5c6a63c4d3c0cd536c4"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:55.001940 19424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:55.042306 19424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:55.044538 19424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:55.044713 19424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:55.045015 19424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:55.045395 19424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:55.045449 19424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:55.045507 19424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:55.045535 19424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:55.053146 19424 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:41349
I20260924 17:35:55.053546 19424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:35:55.054383 19553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:41349 every 8 connection(s)
I20260924 17:35:55.059602 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19424
I20260924 17:35:55.059928 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.6.37.20:47865/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:37685
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:34377
--webserver_port=37937
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:36531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:35:55 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271354, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:55.064203 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:55.054298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:52263 (local address 127.6.37.62:34377)
0924 17:35:55.054345 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:55.054347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:55.054732 (+ 385us) server_negotiation.cc:407] Connection header received
0924 17:35:55.055425 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:55.055427 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:55.055445 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:55.055496 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:55.056107 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.056659 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.057685 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.057911 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.058001 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:55.060711 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:55.060713 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:55.060713 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:55.060722 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:55.062598 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:55.063198 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:55.063199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:55.063199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:55.063250 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:55.063540 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:55.063541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:55.063541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:55.063657 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:55.063730 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:55.064021 (+ 291us) server_negotiation.cc:299] Negotiation successful
0924 17:35:55.064112 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:35:55.064383 19556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:55.054322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34377 (local address 127.6.37.2:52263)
0924 17:35:55.054609 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:55.054641 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:55.055300 (+ 659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:55.055569 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:55.055573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:55.055750 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:55.056007 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:55.056012 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.056765 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.056767 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:55.057589 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:55.057592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.058035 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.058037 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:55.058165 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:55.058722 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:55.058733 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:55.060592 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:55.062704 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:55.062713 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:55.062716 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:55.063106 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:55.063335 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:55.063336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:55.063337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:55.063462 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:55.063732 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:55.063739 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:55.063882 (+ 143us) client_negotiation.cc:769] Sending connection context
0924 17:35:55.063988 (+ 106us) client_negotiation.cc:240] Negotiation successful
0924 17:35:55.064134 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":90,"threads_started":1}
I20260924 17:35:55.064888 19554 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34377
I20260924 17:35:55.064991 19554 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.065176 19554 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
W20260924 17:35:55.065829 19554 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:34377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 17:35:55.065919 19554 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.065994 19554 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:55.066376 19554 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.066469 19554 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
W20260924 17:35:55.066757 19554 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:35:55.184780 19557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:55.185056 19557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:55.185098 19557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:55.186542 19557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:55.186595 19557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:55.186638 19557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:35:55.188202 19557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:36531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.6.37.20:47865/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:37685
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=37937
--tserver_master_addrs=127.6.37.62:34377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:55.188457 19557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:55.188726 19557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:55.194242 19565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:55.194316 19563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:55.194700 19557 server_base.cc:1034] running on GCE node
W20260924 17:35:55.194921 19562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:55.195151 19557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:55.195413 19557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:55.196561 19557 hybrid_clock.cc:648] HybridClock initialized: now 1790271355196558 us; error 37 us; skew 500 ppm
Sep 24 17:35:55 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271355, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:55.199213 19557 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:35:55.199777 19557 webserver.cc:460] Webserver started at http://127.6.37.3:37937/ using document root <none> and password file <none>
I20260924 17:35:55.200029 19557 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:55.200101 19557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 24 17:35:55 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271355, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:55.214208 19557 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260924 17:35:55.215385 19573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:55.215565 19557 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:55.215652 19557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "d5ab6e395e014cbe89d150633eae0be1"
format_stamp: "Formatted at 2026-09-24 17:35:54 on dist-test-slave-gcz9"
server_key: "b89b9c071ccdf8e77eabd25d45aa321c"
server_key_iv: "8537f04ffefff4a215728a464ecaaf5a"
server_key_version: "kuduclusterkey@0"
I20260924 17:35:55.216143 19557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:55.248723 19557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:55.251917 19557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:55.252138 19557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:55.252420 19557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:35:55.252907 19557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:35:55.253021 19557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:55.253106 19557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:35:55.253173 19557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:55.263377 19557 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:37685
I20260924 17:35:55.263854 19557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:35:55.265345 19687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:37685 every 8 connection(s)
I20260924 17:35:55.267727 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19557
Sep 24 17:35:55 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271355, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:55.275942 19690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:55.264718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34377 (local address 127.6.37.3:42389)
0924 17:35:55.265674 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:55.265714 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:55.266232 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:55.266693 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:55.266698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:55.266943 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:55.267165 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:55.267170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.268235 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.268236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:55.269057 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:55.269059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.269607 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.269608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:55.269758 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:55.270381 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:55.270391 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:55.272250 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:55.274243 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:55.274249 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:55.274252 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:55.274557 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:55.274777 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:55.274777 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:55.274778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:55.274942 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:55.275227 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:55.275233 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:55.275411 (+ 178us) client_negotiation.cc:769] Sending connection context
0924 17:35:55.275532 (+ 121us) client_negotiation.cc:240] Negotiation successful
0924 17:35:55.275691 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"thread_start_us":88,"threads_started":1}
I20260924 17:35:55.276480 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:55.265015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:42389 (local address 127.6.37.62:34377)
0924 17:35:55.265063 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:55.265065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:55.265819 (+ 754us) server_negotiation.cc:407] Connection header received
0924 17:35:55.266339 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:55.266340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:55.266353 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:55.266412 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:55.267269 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.267987 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.269152 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.269447 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.269507 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:55.272372 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:55.272373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:55.272373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:55.272380 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:55.274168 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:55.274643 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:55.274644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:55.274644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:55.274700 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:55.275035 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:55.275037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:55.275037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:55.275172 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:55.275235 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:55.276218 (+ 983us) server_negotiation.cc:299] Negotiation successful
0924 17:35:55.276367 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:35:55.276800 19688 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34377
I20260924 17:35:55.276899 19688 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.277102 19688 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
W20260924 17:35:55.277743 19688 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:34377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260924 17:35:55.277813 19688 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.277880 19688 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:55.278127 19692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:55.268122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54470 (local address 127.6.37.62:34377)
0924 17:35:55.269198 (+ 1076us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:55.269200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:55.269383 (+ 183us) server_negotiation.cc:407] Connection header received
0924 17:35:55.269401 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:55.269402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:55.269413 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:55.269469 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:55.270271 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.271056 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.272164 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:55.272486 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:55.272558 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:55.274266 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:55.274267 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:55.274267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:55.274273 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:55.276381 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:55.277102 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:55.277104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:55.277104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:55.277180 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:55.277514 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:55.277515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:55.277515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:55.277669 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:55.277874 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:55.277925 (+ 51us) server_negotiation.cc:299] Negotiation successful
0924 17:35:55.278023 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1057,"thread_start_us":63,"threads_started":1}
I20260924 17:35:55.278170 19688 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.278244 19688 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
W20260924 17:35:55.278627 19688 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 24 17:35:55 dist-test-slave-gcz9 krb5kdc[18216](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790271355, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:55.859539 19420 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:55.859709 19420 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:55.860095 19221 ts_manager.cc:194] Registered new tserver with Master: 702c30bf78684bc18e8d95d707cfdace (127.6.37.1:36793)
I20260924 17:35:55.861168 19221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:41533
I20260924 17:35:56.066957 19554 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:56.067137 19554 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:56.067468 19221 ts_manager.cc:194] Registered new tserver with Master: 5439d5b15210430fb528d6327f9a20b7 (127.6.37.2:41349)
I20260924 17:35:56.068034 19221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:52263
Sep 24 17:35:56 dist-test-slave-gcz9 krb5kdc[18216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271355, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for HTTP/127.6.37.20@KRBTEST.COM
I20260924 17:35:56.278790 19688 heartbeater.cc:464] Registering TS with master...
I20260924 17:35:56.278986 19688 heartbeater.cc:511] Master 127.6.37.62:34377 requested a full tablet report, sending...
I20260924 17:35:56.279289 19221 ts_manager.cc:194] Registered new tserver with Master: d5ab6e395e014cbe89d150633eae0be1 (127.6.37.3:37685)
I20260924 17:35:56.279863 19221 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:42389
I20260924 17:35:56.287058 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:35:56.296535 19710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.288335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54482 (local address 127.6.37.62:34377)
0924 17:35:56.288610 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.288612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.288618 (+ 6us) server_negotiation.cc:407] Connection header received
0924 17:35:56.288651 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.288651 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.288663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.289435 (+ 772us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:56.289474 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.290294 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.291420 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.291738 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.292065 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.293251 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:56.293253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:56.293253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:56.293260 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:56.295029 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:56.295432 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:56.295433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:56.295433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:56.295491 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:56.295704 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:56.295705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:56.295705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:56.295820 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:56.296287 (+ 467us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.296340 (+ 53us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.296418 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":77,"threads_started":1}
I20260924 17:35:56.298730 19221 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:35:56.301311 19221 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:35:56.318534 19716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.305763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:41349 (local address 127.0.0.1:45546)
0924 17:35:56.306552 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.306559 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:56.306588 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:56.307330 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:56.307333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:56.307336 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:56.307406 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.307407 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.311154 (+ 3747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.311155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.312525 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.312529 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.318198 (+ 5669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.318199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.318288 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.318314 (+ 26us) client_negotiation.cc:769] Sending connection context
0924 17:35:56.318386 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:35:56.318443 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":779,"thread_start_us":91,"threads_started":1}
I20260924 17:35:56.318924 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.305887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.6.37.2:41349)
0924 17:35:56.307045 (+ 1158us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.307050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.307061 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:35:56.307100 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.307102 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.307120 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.307213 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:56.307487 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.309266 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.312636 (+ 3370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.315490 (+ 2854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.318088 (+ 2598us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.318170 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.318762 (+ 592us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.318814 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1122,"thread_start_us":48,"threads_started":1}
I20260924 17:35:56.319660 19477 tablet_service.cc:1467] Processing CreateTablet for tablet 5e99c30cb387449987b79bd327668c55 (DEFAULT_TABLE table=test-table [id=dd58f69772f940bfb2105a38311d1457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:35:56.320065 19477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e99c30cb387449987b79bd327668c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:56.322031 19718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.305565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36793 (local address 127.0.0.1:36750)
0924 17:35:56.306449 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.306458 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:56.306488 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:56.309387 (+ 2899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:56.309388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:56.309391 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:56.309449 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.309451 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.315606 (+ 6155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.315607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.317076 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.317079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.321776 (+ 4697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.321778 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.321876 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.321882 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:35:56.321915 (+ 33us) client_negotiation.cc:240] Negotiation successful
0924 17:35:56.321955 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":872,"thread_start_us":88,"threads_started":1}
I20260924 17:35:56.322455 19719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.305667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36750 (local address 127.6.37.1:36793)
0924 17:35:56.308179 (+ 2512us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.308185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.308195 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:35:56.308233 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.308236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.308252 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.309523 (+ 1271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:56.309631 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.314767 (+ 5136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.317179 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.317979 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.322199 (+ 4220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.322284 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.322326 (+ 42us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.322378 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2476,"thread_start_us":51,"threads_started":1}
I20260924 17:35:56.322980 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.305317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:37685 (local address 127.0.0.1:46244)
0924 17:35:56.306237 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.306278 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:56.306351 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:56.313186 (+ 6835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:56.313187 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:56.313189 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:56.313228 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.313230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.319216 (+ 5986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.319217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.320376 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.320378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.322750 (+ 2372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.322751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.322822 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.322826 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:35:56.322856 (+ 30us) client_negotiation.cc:240] Negotiation successful
0924 17:35:56.322915 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"thread_start_us":77,"threads_started":1}
I20260924 17:35:56.323154 19354 tablet_service.cc:1467] Processing CreateTablet for tablet 5e99c30cb387449987b79bd327668c55 (DEFAULT_TABLE table=test-table [id=dd58f69772f940bfb2105a38311d1457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:35:56.323383 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.305399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46244 (local address 127.6.37.3:37685)
0924 17:35:56.310967 (+ 5568us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.310971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.310983 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:35:56.311019 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.311022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.311038 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.313319 (+ 2281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:56.313403 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.314495 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.320785 (+ 6290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.321637 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.323128 (+ 1491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.323213 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.323242 (+ 29us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.323293 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5527,"thread_start_us":40,"threads_started":1}
I20260924 17:35:56.323498 19354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e99c30cb387449987b79bd327668c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:56.324002 19604 tablet_service.cc:1467] Processing CreateTablet for tablet 5e99c30cb387449987b79bd327668c55 (DEFAULT_TABLE table=test-table [id=dd58f69772f940bfb2105a38311d1457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:35:56.324335 19604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e99c30cb387449987b79bd327668c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:56.328315 19722 tablet_bootstrap.cc:492] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Bootstrap starting.
I20260924 17:35:56.329035 19722 tablet_bootstrap.cc:654] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:56.329056 19724 tablet_bootstrap.cc:492] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: Bootstrap starting.
I20260924 17:35:56.329396 19722 log.cc:824] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:56.329748 19724 tablet_bootstrap.cc:654] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:56.330067 19724 log.cc:824] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:56.330976 19724 tablet_bootstrap.cc:492] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: No bootstrap required, opened a new log
I20260924 17:35:56.330976 19722 tablet_bootstrap.cc:492] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: No bootstrap required, opened a new log
I20260924 17:35:56.331056 19724 ts_tablet_manager.cc:1397] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:35:56.331169 19722 ts_tablet_manager.cc:1397] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:35:56.333768 19722 raft_consensus.cc:348] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.334106 19722 raft_consensus.cc:374] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:56.334218 19722 raft_consensus.cc:729] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ab6e395e014cbe89d150633eae0be1, State: Initialized, Role: FOLLOWER
I20260924 17:35:56.334295 19724 raft_consensus.cc:348] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.334466 19724 raft_consensus.cc:374] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:56.334510 19724 raft_consensus.cc:729] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 702c30bf78684bc18e8d95d707cfdace, State: Initialized, Role: FOLLOWER
I20260924 17:35:56.334542 19722 consensus_queue.cc:260] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.334656 19724 consensus_queue.cc:260] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.334959 19724 ts_tablet_manager.cc:1428] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260924 17:35:56.334987 19722 ts_tablet_manager.cc:1428] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260924 17:35:56.335117 19420 heartbeater.cc:503] Master 127.6.37.62:34377 was elected leader, sending a full tablet report...
I20260924 17:35:56.335224 19688 heartbeater.cc:503] Master 127.6.37.62:34377 was elected leader, sending a full tablet report...
I20260924 17:35:56.339035 19723 tablet_bootstrap.cc:492] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: Bootstrap starting.
I20260924 17:35:56.339736 19723 tablet_bootstrap.cc:654] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:56.340088 19723 log.cc:824] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:56.340971 19723 tablet_bootstrap.cc:492] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: No bootstrap required, opened a new log
I20260924 17:35:56.341038 19723 ts_tablet_manager.cc:1397] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
W20260924 17:35:56.342196 19421 tablet.cc:2369] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:35:56.343578 19723 raft_consensus.cc:348] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.343737 19723 raft_consensus.cc:374] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:56.343767 19723 raft_consensus.cc:729] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5439d5b15210430fb528d6327f9a20b7, State: Initialized, Role: FOLLOWER
I20260924 17:35:56.343907 19723 consensus_queue.cc:260] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.344159 19723 ts_tablet_manager.cc:1428] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:35:56.344334 19554 heartbeater.cc:503] Master 127.6.37.62:34377 was elected leader, sending a full tablet report...
I20260924 17:35:56.348192 19730 raft_consensus.cc:482] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:35:56.348459 19730 raft_consensus.cc:504] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.349102 19730 leader_election.cc:288] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ab6e395e014cbe89d150633eae0be1 (127.6.37.3:37685), 702c30bf78684bc18e8d95d707cfdace (127.6.37.1:36793)
I20260924 17:35:56.353544 19731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.349436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36793 (local address 127.6.37.2:37301)
0924 17:35:56.349920 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.349928 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:56.349995 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:56.350165 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:56.350166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:56.350168 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:56.350246 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.350248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.351237 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.351237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.352453 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.352455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.353281 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.353281 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.353352 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.353356 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:35:56.353409 (+ 53us) client_negotiation.cc:240] Negotiation successful
0924 17:35:56.353446 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":3,"thread_start_us":55,"threads_started":1}
I20260924 17:35:56.353551 19719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.349581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:37301 (local address 127.6.37.1:36793)
0924 17:35:56.349686 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.349689 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.349968 (+ 279us) server_negotiation.cc:407] Connection header received
0924 17:35:56.350063 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.350064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.350076 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.350104 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:56.350334 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.351144 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.352558 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.353142 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.353187 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.353199 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.353437 (+ 238us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.353483 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260924 17:35:56.354115 19374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e99c30cb387449987b79bd327668c55" candidate_uuid: "5439d5b15210430fb528d6327f9a20b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702c30bf78684bc18e8d95d707cfdace" is_pre_election: true
I20260924 17:35:56.354168 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.349600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:59239 (local address 127.6.37.3:37685)
0924 17:35:56.349646 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.349648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.349843 (+ 195us) server_negotiation.cc:407] Connection header received
0924 17:35:56.349901 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.349903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.349925 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.350033 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:35:56.350455 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.351426 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.353217 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.353803 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.353902 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.353912 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.354069 (+ 157us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.354108 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:35:56.354254 19374 raft_consensus.cc:2454] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5439d5b15210430fb528d6327f9a20b7 in term 0.
I20260924 17:35:56.354377 19732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.349241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:37685 (local address 127.6.37.2:59239)
0924 17:35:56.349744 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.349755 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:56.349833 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:56.350128 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:56.350130 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:56.350132 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:35:56.350306 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.350308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.351867 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.351868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.353112 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:56.353117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.353906 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.353907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:56.353983 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.353987 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:35:56.354266 (+ 279us) client_negotiation.cc:240] Negotiation successful
0924 17:35:56.354306 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":80,"threads_started":1}
I20260924 17:35:56.354487 19444 leader_election.cc:302] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5439d5b15210430fb528d6327f9a20b7, 702c30bf78684bc18e8d95d707cfdace; no voters:
I20260924 17:35:56.354620 19730 raft_consensus.cc:2781] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:35:56.354676 19730 raft_consensus.cc:482] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:35:56.354697 19730 raft_consensus.cc:3037] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:56.354807 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e99c30cb387449987b79bd327668c55" candidate_uuid: "5439d5b15210430fb528d6327f9a20b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab6e395e014cbe89d150633eae0be1" is_pre_election: true
I20260924 17:35:56.354974 19642 raft_consensus.cc:2454] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5439d5b15210430fb528d6327f9a20b7 in term 0.
I20260924 17:35:56.355639 19730 raft_consensus.cc:504] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.355907 19642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e99c30cb387449987b79bd327668c55" candidate_uuid: "5439d5b15210430fb528d6327f9a20b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ab6e395e014cbe89d150633eae0be1"
I20260924 17:35:56.355976 19642 raft_consensus.cc:3037] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:56.356860 19642 raft_consensus.cc:2454] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5439d5b15210430fb528d6327f9a20b7 in term 1.
I20260924 17:35:56.357025 19444 leader_election.cc:302] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5439d5b15210430fb528d6327f9a20b7, d5ab6e395e014cbe89d150633eae0be1; no voters:
I20260924 17:35:56.357328 19374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e99c30cb387449987b79bd327668c55" candidate_uuid: "5439d5b15210430fb528d6327f9a20b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "702c30bf78684bc18e8d95d707cfdace"
I20260924 17:35:56.357406 19374 raft_consensus.cc:3037] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:56.358290 19374 raft_consensus.cc:2454] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5439d5b15210430fb528d6327f9a20b7 in term 1.
I20260924 17:35:56.358497 19730 leader_election.cc:288] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [CANDIDATE]: Term 1 election: Requested vote from peers d5ab6e395e014cbe89d150633eae0be1 (127.6.37.3:37685), 702c30bf78684bc18e8d95d707cfdace (127.6.37.1:36793)
I20260924 17:35:56.358559 19730 raft_consensus.cc:2781] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:35:56.358594 19730 raft_consensus.cc:686] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 1 LEADER]: Becoming Leader. State: Replica: 5439d5b15210430fb528d6327f9a20b7, State: Running, Role: LEADER
I20260924 17:35:56.358664 19730 consensus_queue.cc:237] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } }
I20260924 17:35:56.359529 19221 catalog_manager.cc:5495] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5439d5b15210430fb528d6327f9a20b7 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "5439d5b15210430fb528d6327f9a20b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5439d5b15210430fb528d6327f9a20b7" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 41349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 } health_report { overall_health: UNKNOWN } } }
I20260924 17:35:56.369472 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.365726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45556 (local address 127.6.37.2:41349)
0924 17:35:56.365783 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:56.365785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:56.365794 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:35:56.365841 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:56.365842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:56.365862 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:56.365927 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:35:56.366149 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.366977 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.368216 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:56.368541 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:56.368607 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:56.368897 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:35:56.369029 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:35:56.369114 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:56.369367 (+ 253us) server_negotiation.cc:299] Negotiation successful
0924 17:35:56.369392 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260924 17:35:56.371537 19374 raft_consensus.cc:1261] T 5e99c30cb387449987b79bd327668c55 P 702c30bf78684bc18e8d95d707cfdace [term 1 FOLLOWER]: Refusing update from remote peer 5439d5b15210430fb528d6327f9a20b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:35:56.372012 19733 consensus_queue.cc:1035] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "702c30bf78684bc18e8d95d707cfdace" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:35:56.374133 19642 raft_consensus.cc:1261] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 1 FOLLOWER]: Refusing update from remote peer 5439d5b15210430fb528d6327f9a20b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:35:56.374399 19733 consensus_queue.cc:1035] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ab6e395e014cbe89d150633eae0be1" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:35:56.378513 19736 mvcc.cc:205] Tried to move back new op lower bound from 7332951475694317568 to 7332951475645820928. Current Snapshot: MvccSnapshot[applied={T|T < 7332951475694317568}]
I20260924 17:35:56.378623 19737 mvcc.cc:205] Tried to move back new op lower bound from 7332951475694317568 to 7332951475645820928. Current Snapshot: MvccSnapshot[applied={T|T < 7332951475694317568}]
I20260924 17:35:56.380898 19739 mvcc.cc:205] Tried to move back new op lower bound from 7332951475694317568 to 7332951475645820928. Current Snapshot: MvccSnapshot[applied={T|T < 7332951475694317568}]
I20260924 17:35:56.382210 19221 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:35:56.382321 19221 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:35:56.383131 19221 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a91801f99c824c568aea0bb72bfc4f29: Sending DeleteTablet for 3 replicas of tablet 5e99c30cb387449987b79bd327668c55
I20260924 17:35:56.383620 19604 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e99c30cb387449987b79bd327668c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:35:56 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:46244
I20260924 17:35:56.383872 19354 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e99c30cb387449987b79bd327668c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:35:56 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:36750
I20260924 17:35:56.384346 19477 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e99c30cb387449987b79bd327668c55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:35:56 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:45546
I20260924 17:35:56.384510 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19259
I20260924 17:35:56.384595 19745 tablet_replica.cc:330] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: stopping tablet replica
I20260924 17:35:56.384694 19745 raft_consensus.cc:2229] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:35:56.384783 19745 raft_consensus.cc:2258] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:35:56.385094 19747 tablet_replica.cc:330] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7: stopping tablet replica
I20260924 17:35:56.385182 19747 raft_consensus.cc:2229] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:35:56.385315 19747 raft_consensus.cc:2258] T 5e99c30cb387449987b79bd327668c55 P 5439d5b15210430fb528d6327f9a20b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:35:56.385557 19745 ts_tablet_manager.cc:1905] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:35:56.387681 19745 ts_tablet_manager.cc:1918] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:35:56.387763 19745 log.cc:1196] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/5e99c30cb387449987b79bd327668c55
I20260924 17:35:56.388034 19745 ts_tablet_manager.cc:1939] T 5e99c30cb387449987b79bd327668c55 P d5ab6e395e014cbe89d150633eae0be1: Deleting consensus metadata
I20260924 17:35:56.388638 19208 catalog_manager.cc:4841] TS d5ab6e395e014cbe89d150633eae0be1 (127.6.37.3:37685): tablet 5e99c30cb387449987b79bd327668c55 (table test-table [id=dd58f69772f940bfb2105a38311d1457]) successfully deleted
W20260924 17:35:56.392840 19208 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:36793 (error 108)
I20260924 17:35:56.393419 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19424
I20260924 17:35:56.396236 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.396064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36793 (local address 127.0.0.1:36760)
0924 17:35:56.396128 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.396195 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:36793: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260924 17:35:56.396370 19208 catalog_manager.cc:4584] TS 702c30bf78684bc18e8d95d707cfdace (127.6.37.1:36793): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5e99c30cb387449987b79bd327668c55: Network error: Client connection negotiation failed: client connection to 127.6.37.1:36793: connect: Connection refused (error 111)
I20260924 17:35:56.400372 19720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:56.400260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:41349 (local address 127.0.0.1:45564)
0924 17:35:56.400313 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:56.400338 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.2:41349: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260924 17:35:56.400563 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19557
I20260924 17:35:56.406383 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19188
I20260924 17:35:56.414083 6292 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260924 17:35:56.759400 6292 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260924 17:35:56.759510 6292 mini_ranger.cc:66] Stopping Ranger...
I20260924 17:35:57.103765 6292 mini_ranger.cc:68] Stopped Ranger
2026-09-24 17:35:57.103 UTC [18246] LOG: received smart shutdown request
2026-09-24 17:35:57.108 UTC [18246] LOG: background worker "logical replication launcher" (PID 18255) exited with exit code 1
2026-09-24 17:35:57.108 UTC [18250] LOG: shutting down
2026-09-24 17:35:57.283 UTC [18246] LOG: database system is shut down
2026-09-24T17:35:57Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48645 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:35:57 dist-test-slave-gcz9 krb5kdc[19757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:35:57 dist-test-slave-gcz9 krb5kdc[19757](info): set up 2 sockets
Sep 24 17:35:57 dist-test-slave-gcz9 krb5kdc[19757](info): commencing operation
krb5kdc: starting...
W20260924 17:35:58.456894 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:35:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:35:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:35:58.571883 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40719
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:40719,127.6.37.61:38819,127.6.37.60:43043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:35:58.654250 19770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:58.654490 19770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:58.654532 19770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:58.655833 19770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:35:58.655892 19770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:58.655923 19770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:58.655956 19770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:35:58.655987 19770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:35:58.657545 19770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:40719,127.6.37.61:38819,127.6.37.60:43043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:58.657828 19770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:58.658061 19770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:58.662938 19776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:58.662938 19775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:58.663242 19770 server_base.cc:1034] running on GCE node
W20260924 17:35:58.662940 19778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:58.663470 19770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:58.663733 19770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:58.664871 19770 hybrid_clock.cc:648] HybridClock initialized: now 1790271358664858 us; error 37 us; skew 500 ppm
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:58.667505 19770 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:35:58.667903 19770 webserver.cc:460] Webserver started at http://127.6.37.62:37547/ using document root <none> and password file <none>
I20260924 17:35:58.668134 19770 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:58.668179 19770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:58.668344 19770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:35:58.669340 19770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "50ee80d527aa4995a5b3dd1240bc1bdb"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "ee4f44ff6cb1f014e2be0b5368c553ab"
server_key_iv: "498fede4c0732737bdbb7972a5255148"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.669683 19770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "50ee80d527aa4995a5b3dd1240bc1bdb"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "ee4f44ff6cb1f014e2be0b5368c553ab"
server_key_iv: "498fede4c0732737bdbb7972a5255148"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.671082 19770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:35:58.671830 19785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:58.672030 19770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:58.672119 19770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "50ee80d527aa4995a5b3dd1240bc1bdb"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "ee4f44ff6cb1f014e2be0b5368c553ab"
server_key_iv: "498fede4c0732737bdbb7972a5255148"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.672189 19770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:58.688874 19770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:58.690982 19770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:58.691138 19770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:58.694962 19770 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:40719
I20260924 17:35:58.694984 19837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:40719 every 8 connection(s)
I20260924 17:35:58.695354 19770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:35:58.696146 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19770
I20260924 17:35:58.696249 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:35:58.696404 19838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:58.696508 6292 external_mini_cluster.cc:1428] Setting key c4656ed5469bda3ec894217942ef7981
I20260924 17:35:58.698647 19838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.6.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.61@KRBTEST.COM" created.
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:58.711068 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.699406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40719 (local address 127.0.0.1:56800)
0924 17:35:58.699591 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.699629 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:58.700190 (+ 561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:58.700489 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:58.700492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:58.700775 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:58.700936 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.700941 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.701933 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.701934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.702634 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.702636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.703209 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.703211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.703276 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.703819 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:58.703828 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:58.707491 (+ 3663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:58.709397 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.709404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.709406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.709637 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.709930 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.709931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.709932 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.710026 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.710436 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:58.710442 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:58.710509 (+ 67us) client_negotiation.cc:769] Sending connection context
0924 17:35:58.710626 (+ 117us) client_negotiation.cc:240] Negotiation successful
0924 17:35:58.710865 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":96,"thread_start_us":97,"threads_started":1}
I20260924 17:35:58.711068 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.699411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56800 (local address 127.6.37.62:40719)
0924 17:35:58.699589 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:58.699599 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:58.699726 (+ 127us) server_negotiation.cc:407] Connection header received
0924 17:35:58.700360 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:58.700361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:58.700379 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:58.700480 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:58.701037 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.701838 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.702729 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.703107 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.703242 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.707594 (+ 4352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:58.707604 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:58.707605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:58.707613 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:58.709271 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.709737 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.709740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.709741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.709851 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.710111 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.710112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.710112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.710358 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:58.710459 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:58.710651 (+ 192us) server_negotiation.cc:299] Negotiation successful
0924 17:35:58.710796 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260924 17:35:58.711825 19838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:35:58.712200 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.712091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45412)
0924 17:35:58.712136 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.712180 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260924 17:35:58.712373 19787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
I20260924 17:35:58.712842 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.712703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45418)
0924 17:35:58.712749 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.712823 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260924 17:35:58.712947 19838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:38819: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab.
Entry for principal kudu/127.6.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab.
I20260924 17:35:58.722218 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:38819
--webserver_interface=127.6.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab
--principal=kudu/127.6.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:40719,127.6.37.61:38819,127.6.37.60:43043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:35:58.762182 19838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } attempt: 1
I20260924 17:35:58.762746 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.762597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45432)
0924 17:35:58.762666 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.762711 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260924 17:35:58.763211 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.763114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45434)
0924 17:35:58.763158 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.763190 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260924 17:35:58.763316 19838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:38819: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
W20260924 17:35:58.802347 19845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:58.802582 19845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:58.802620 19845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:58.803785 19845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:35:58.803848 19845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:58.803874 19845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:58.803906 19845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:35:58.803931 19845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:35:58.805419 19845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:40719,127.6.37.61:38819,127.6.37.60:43043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab
--principal=kudu/127.6.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:38819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:58.805706 19845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:58.805913 19845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:35:58.810616 19850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:58.810724 19853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:58.810621 19851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:58.810854 19845 server_base.cc:1034] running on GCE node
I20260924 17:35:58.811162 19845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:58.811467 19845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:58.812657 19845 hybrid_clock.cc:648] HybridClock initialized: now 1790271358812643 us; error 26 us; skew 500 ppm
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:58.815178 19845 init.cc:377] Logged in from keytab as kudu/127.6.37.61@KRBTEST.COM (short username kudu)
I20260924 17:35:58.815603 19845 webserver.cc:460] Webserver started at http://127.6.37.61:43897/ using document root <none> and password file <none>
I20260924 17:35:58.815829 19845 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:58.815894 19845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:58.816037 19845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:35:58.817170 19845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data/instance:
uuid: "e79af9bab2f0446da9a6f4a9e272f11f"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "a244be62569a7b7ad384c17e0db7e7ad"
server_key_iv: "f3704690b04d3c51ebadbbbc8f510a31"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.817523 19845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal/instance:
uuid: "e79af9bab2f0446da9a6f4a9e272f11f"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "a244be62569a7b7ad384c17e0db7e7ad"
server_key_iv: "f3704690b04d3c51ebadbbbc8f510a31"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.818917 19845 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:35:58.819736 19860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:58.819927 19845 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:35:58.820029 19845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal
uuid: "e79af9bab2f0446da9a6f4a9e272f11f"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "a244be62569a7b7ad384c17e0db7e7ad"
server_key_iv: "f3704690b04d3c51ebadbbbc8f510a31"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.820112 19845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:58.831451 19838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } attempt: 2
I20260924 17:35:58.831854 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.831730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45438)
0924 17:35:58.831782 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.831826 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260924 17:35:58.832150 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.832077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45452)
0924 17:35:58.832112 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.832134 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260924 17:35:58.832254 19838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:38819: Network error: Client connection negotiation failed: client connection to 127.6.37.61:38819: connect: Connection refused (error 111)
I20260924 17:35:58.834297 19845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:58.836076 19845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:58.836220 19845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:58.840152 19845 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.61:38819
I20260924 17:35:58.840219 19912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.61:38819 every 8 connection(s)
I20260924 17:35:58.840552 19845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
I20260924 17:35:58.841338 19913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:58.842769 19913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:35:58.846704 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19845
I20260924 17:35:58.846817 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-1/wal/instance
I20260924 17:35:58.847056 6292 external_mini_cluster.cc:1428] Setting key 886e94487cb05150f9aeeb54279dcd87
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:58.851824 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.843501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56804 (local address 127.6.37.62:40719)
0924 17:35:58.843548 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:58.843550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:58.843696 (+ 146us) server_negotiation.cc:407] Connection header received
0924 17:35:58.844118 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:58.844119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:58.844131 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:58.844191 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:58.844864 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.845348 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.846283 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.846525 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.846605 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.848891 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:58.848893 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:58.848893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:58.848901 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:58.850319 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.850823 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.850824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.850824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.850912 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.851188 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.851189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.851189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.851294 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:58.851344 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:58.851691 (+ 347us) server_negotiation.cc:299] Negotiation successful
0924 17:35:58.851763 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:35:58.852152 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.843423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40719 (local address 127.0.0.1:56804)
0924 17:35:58.843577 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.843617 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:58.844040 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:58.844248 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:58.844252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:58.844526 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:58.844712 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.844716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.845438 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.845438 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.846199 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.846201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.846609 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.846609 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.846711 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.847252 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:58.847260 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:58.848770 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:58.850402 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.850410 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.850412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.850742 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.850977 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.850978 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.850978 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.851121 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.851362 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:58.851370 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:58.851551 (+ 181us) client_negotiation.cc:769] Sending connection context
0924 17:35:58.851679 (+ 128us) client_negotiation.cc:240] Negotiation successful
0924 17:35:58.851875 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260924 17:35:58.852736 19913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.6.37.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.60@KRBTEST.COM" created.
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:35:58.861833 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.853006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45458)
0924 17:35:58.853060 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.853072 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:58.853116 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:58.853354 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:58.853355 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:58.853513 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:58.853575 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.853577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.854386 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.854387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.855283 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.855286 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.855711 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.855712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.855768 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.856215 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:58.856219 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:58.858513 (+ 2294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:58.860788 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.860789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.860789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.860947 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.861182 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.861183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.861183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.861232 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.861598 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:58.861599 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:58.861645 (+ 46us) client_negotiation.cc:769] Sending connection context
0924 17:35:58.861700 (+ 55us) client_negotiation.cc:240] Negotiation successful
0924 17:35:58.861770 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260924 17:35:58.861974 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.853067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45458 (local address 127.6.37.61:38819)
0924 17:35:58.853215 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:58.853220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:58.853240 (+ 20us) server_negotiation.cc:407] Connection header received
0924 17:35:58.853260 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:58.853261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:58.853271 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:58.853332 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:58.853646 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.854305 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.855359 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.855647 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.855704 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.858603 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:58.858611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:58.858611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:58.858618 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:58.860701 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.861029 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.861033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.861033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.861105 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.861301 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.861302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.861303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.861511 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:58.861616 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:58.861744 (+ 128us) server_negotiation.cc:299] Negotiation successful
0924 17:35:58.861835 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":97,"threads_started":1}
I20260924 17:35:58.862733 19913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:35:58.863135 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.862994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57302)
0924 17:35:58.863046 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.863103 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:35:58.863296 19862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
I20260924 17:35:58.863754 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.863652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57308)
0924 17:35:58.863701 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.863732 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:35:58.863932 19913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:43043: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab.
Entry for principal kudu/127.6.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab.
I20260924 17:35:58.873505 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:43043
--webserver_interface=127.6.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab
--principal=kudu/127.6.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:38253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:40719,127.6.37.61:38819,127.6.37.60:43043
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:35:58.913185 19913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } attempt: 1
I20260924 17:35:58.913779 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.913632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57324)
0924 17:35:58.913697 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.913744 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260924 17:35:58.914171 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.914075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57340)
0924 17:35:58.914118 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.914147 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260924 17:35:58.914297 19913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:43043: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
I20260924 17:35:58.923437 19838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } attempt: 3
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:35:58.931036 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.923749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45474)
0924 17:35:58.923818 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.923833 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:58.923910 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:58.924090 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:58.924091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:58.924239 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:58.924313 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.924315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.925313 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.925321 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.925878 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:58.925881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.926406 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.926408 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:58.926488 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.927010 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:58.927016 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:58.928372 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:58.930097 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.930098 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.930098 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.930253 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.930449 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:58.930449 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:58.930450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:58.930498 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:58.930756 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:58.930757 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:58.930794 (+ 37us) client_negotiation.cc:769] Sending connection context
0924 17:35:58.930842 (+ 48us) client_negotiation.cc:240] Negotiation successful
0924 17:35:58.930967 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260924 17:35:58.931066 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.923839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45474 (local address 127.6.37.61:38819)
0924 17:35:58.923904 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:58.923907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:58.923918 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:35:58.923970 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:58.923971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:58.923985 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:58.924057 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:58.924404 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.925200 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.925965 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:58.926299 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:58.926374 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:58.928465 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:58.928466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:58.928467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:58.928474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:58.930006 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.930316 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.930318 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.930318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.930384 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:58.930553 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:58.930553 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:58.930554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:58.930690 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:58.930761 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:58.930865 (+ 104us) server_negotiation.cc:299] Negotiation successful
0924 17:35:58.930965 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:35:58.931468 19838 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:35:58.931808 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.931698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57350)
0924 17:35:58.931750 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.931783 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260924 17:35:58.932103 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.932017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57354)
0924 17:35:58.932058 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.932085 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260924 17:35:58.932189 19838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:43043: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
W20260924 17:35:58.956883 19920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:35:58.957113 19920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:35:58.957151 19920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:35:58.958299 19920 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:35:58.958360 19920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:35:58.958385 19920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:35:58.958412 19920 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:35:58.958441 19920 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:35:58.959942 19920 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:40719,127.6.37.61:38819,127.6.37.60:43043
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab
--principal=kudu/127.6.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:43043
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.6.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:35:58.960214 19920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:35:58.960434 19920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:35:58.963344 19838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } attempt: 1
I20260924 17:35:58.963791 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.963671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57368)
0924 17:35:58.963726 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.963762 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260924 17:35:58.964531 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.964387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57382)
0924 17:35:58.964458 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.964497 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:35:58.964664 19838 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:43043: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
W20260924 17:35:58.965081 19925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:58.965087 19926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:35:58.965193 19928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:35:58.965577 19920 server_base.cc:1034] running on GCE node
I20260924 17:35:58.965799 19920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:35:58.966102 19920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:35:58.967268 19920 hybrid_clock.cc:648] HybridClock initialized: now 1790271358967257 us; error 38 us; skew 500 ppm
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:35:58.969640 19920 init.cc:377] Logged in from keytab as kudu/127.6.37.60@KRBTEST.COM (short username kudu)
I20260924 17:35:58.970089 19920 webserver.cc:460] Webserver started at http://127.6.37.60:41111/ using document root <none> and password file <none>
I20260924 17:35:58.970307 19920 fs_manager.cc:359] Metadata directory not provided
I20260924 17:35:58.970374 19920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:35:58.970518 19920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:35:58.971583 19920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data/instance:
uuid: "c0ccf515c96c410a989cb691d76f6b06"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "8591dbf70438e7cf19261c7d0cde067c"
server_key_iv: "0ac6f4d65a35c43935bbf34a8f61f1e1"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.971931 19920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal/instance:
uuid: "c0ccf515c96c410a989cb691d76f6b06"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "8591dbf70438e7cf19261c7d0cde067c"
server_key_iv: "0ac6f4d65a35c43935bbf34a8f61f1e1"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.973186 19920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:35:58.973839 19935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:35:58.974000 19920 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:35:58.974098 19920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal
uuid: "c0ccf515c96c410a989cb691d76f6b06"
format_stamp: "Formatted at 2026-09-24 17:35:58 on dist-test-slave-gcz9"
server_key: "8591dbf70438e7cf19261c7d0cde067c"
server_key_iv: "0ac6f4d65a35c43935bbf34a8f61f1e1"
server_key_version: "encryptionkey@0"
I20260924 17:35:58.974169 19920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:35:58.982453 19913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } attempt: 2
I20260924 17:35:58.982933 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.982790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57388)
0924 17:35:58.982847 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.982903 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260924 17:35:58.983228 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.983162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57400)
0924 17:35:58.983189 (+ 27us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:58.983211 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260924 17:35:58.983335 19913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:43043: Network error: Client connection negotiation failed: client connection to 127.6.37.60:43043: connect: Connection refused (error 111)
I20260924 17:35:58.991168 19920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:35:58.992940 19920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:35:58.993091 19920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:35:58.996964 19920 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.60:43043
I20260924 17:35:58.997033 19987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.60:43043 every 8 connection(s)
I20260924 17:35:58.997368 19920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
I20260924 17:35:58.997982 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 19920
I20260924 17:35:58.998103 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790271173812085-6292-0/minicluster-data/master-2/wal/instance
I20260924 17:35:58.998318 6292 external_mini_cluster.cc:1428] Setting key afbbf1dd2e12cde5330c365726f42c56
I20260924 17:35:58.998374 19988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:35:59.000874 19988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
Sep 24 17:35:58 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:59.008960 19991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:58.998904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57402 (local address 127.6.37.60:43043)
0924 17:35:58.999091 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:58.999100 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:58.999125 (+ 25us) server_negotiation.cc:407] Connection header received
0924 17:35:58.999553 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:58.999560 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:58.999606 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:58.999718 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.000488 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.001481 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.002262 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.002707 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.002784 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.005491 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.005500 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.005500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.005508 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.007312 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.007756 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.007760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.007761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.007870 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.008057 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.008058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.008059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.008359 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.008505 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.008617 (+ 112us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.008740 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260924 17:35:59.009559 19992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.001474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:40719 (local address 127.0.0.1:56820)
0924 17:35:59.001654 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:59.001686 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:59.001763 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:59.001928 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:59.001931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:59.002194 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:59.002284 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.002285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.002990 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.002991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.003713 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.003716 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.004218 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.004219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.004269 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.004711 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:59.004722 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:59.006468 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:59.008346 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.008352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.008353 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.008540 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.008735 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.008735 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.008736 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.008798 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.009204 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:59.009210 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:59.009278 (+ 68us) client_negotiation.cc:769] Sending connection context
0924 17:35:59.009366 (+ 88us) client_negotiation.cc:240] Negotiation successful
0924 17:35:59.009470 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":80,"threads_started":1}
I20260924 17:35:59.009647 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.001535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56820 (local address 127.6.37.62:40719)
0924 17:35:59.001589 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.001591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.001745 (+ 154us) server_negotiation.cc:407] Connection header received
0924 17:35:59.001827 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.001828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.001839 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.001906 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.002370 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.002863 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.003801 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.004131 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.004213 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.006559 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.006561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.006561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.006569 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.008278 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.008617 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.008618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.008618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.008672 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.008864 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.008865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.008865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.008968 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.009045 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.009427 (+ 382us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.009514 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260924 17:35:59.010179 19988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:35:59 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
Sep 24 17:35:59 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:35:59.016928 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.010494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45486 (local address 127.6.37.61:38819)
0924 17:35:59.010559 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.010561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.010587 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:35:59.010660 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.010661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.010671 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.010726 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.010986 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.011574 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.012362 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.012610 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.012675 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.014345 (+ 1670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.014346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.014347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.014354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.015715 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.016141 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.016142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.016142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.016189 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.016397 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.016398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.016398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.016528 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.016613 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.016787 (+ 174us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.016869 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260924 17:35:59.016980 19992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.010423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:38819 (local address 127.0.0.1:45486)
0924 17:35:59.010545 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:59.010556 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:59.010599 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:59.010729 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:59.010729 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:59.010833 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:59.010927 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.010928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.011641 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.011642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.012286 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.012288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.012684 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.012685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.012771 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.013050 (+ 279us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:59.013056 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:59.014240 (+ 1184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:59.015795 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.015797 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.015797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.016058 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.016262 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.016263 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.016264 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.016329 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.016623 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:59.016624 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:59.016667 (+ 43us) client_negotiation.cc:769] Sending connection context
0924 17:35:59.016760 (+ 93us) client_negotiation.cc:240] Negotiation successful
0924 17:35:59.016872 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104}
I20260924 17:35:59.017333 19988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:35:59.018621 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.009837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56832 (local address 127.6.37.62:40719)
0924 17:35:59.009867 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.009869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.009919 (+ 50us) server_negotiation.cc:407] Connection header received
0924 17:35:59.009962 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.009962 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.009971 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.010029 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.010567 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.011259 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.012035 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.012204 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.012252 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.014961 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.014962 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.014962 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.014968 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.017350 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.017835 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.017836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.017837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.017915 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.018106 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.018107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.018107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.018212 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.018395 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.018431 (+ 36us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.018509 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
Sep 24 17:35:59 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
Sep 24 17:35:59 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:35:59.024123 19992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.017551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57406)
0924 17:35:59.017595 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:59.017604 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:59.017659 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:59.017770 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:59.017771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:59.017912 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:59.017932 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.017933 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.018531 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.018533 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.019139 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.019141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.019541 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.019542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.019589 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.019942 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:59.019948 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:59.021299 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:59.023056 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.023057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.023058 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.023288 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.023487 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.023489 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.023489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.023556 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.023794 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:59.023794 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:59.023846 (+ 52us) client_negotiation.cc:769] Sending connection context
0924 17:35:59.023929 (+ 83us) client_negotiation.cc:240] Negotiation successful
0924 17:35:59.024023 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260924 17:35:59.024183 19991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.017611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57406 (local address 127.6.37.60:43043)
0924 17:35:59.017643 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.017645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.017653 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:35:59.017716 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.017717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.017725 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.017770 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.018002 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.018446 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.019276 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.019460 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.019540 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.021386 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.021387 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.021388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.021393 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.022980 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.023358 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.023358 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.023358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.023405 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.023627 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.023627 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.023628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.023722 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.023788 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.023952 (+ 164us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.024072 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":19}
I20260924 17:35:59.026074 19988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: Bootstrap starting.
I20260924 17:35:59.026950 19988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:59.027311 19988 log.cc:824] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:59.027778 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.019230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45488 (local address 127.6.37.61:38819)
0924 17:35:59.019272 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.019274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.019647 (+ 373us) server_negotiation.cc:407] Connection header received
0924 17:35:59.019717 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.019718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.019728 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.019791 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.020355 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.021052 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.021762 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.021958 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.022028 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.024519 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.024521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.024521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.024529 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.026071 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.026413 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.026415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.026415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.026483 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.026674 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.026675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.026676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.026813 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.027607 (+ 794us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.027651 (+ 44us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.027721 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:35:59.028198 19988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: No bootstrap required, opened a new log
I20260924 17:35:59.029181 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:35:59.029918 19988 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.030081 19988 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:59.030138 19988 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0ccf515c96c410a989cb691d76f6b06, State: Initialized, Role: FOLLOWER
I20260924 17:35:59.030359 19988 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.030643 19999 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.030833 19999 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:35:59.030699 19988 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:35:59.032970 19920 master_runner.cc:186] Error getting master registration for 127.6.37.62:40719: OK, instance_id { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" instance_seqno: 1790271358693889 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 17:35:59.036801 19920 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260924 17:35:59.037050 20012 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:35:59.037103 20012 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:35:59.038466 19917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.030474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45494 (local address 127.6.37.61:38819)
0924 17:35:59.030515 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.030517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.030749 (+ 232us) server_negotiation.cc:407] Connection header received
0924 17:35:59.030848 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.030849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.030859 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.030915 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.031699 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.032424 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.033541 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.033817 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.033856 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.035295 (+ 1439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.035296 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.035296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.035303 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.036951 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.037600 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.037602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.037602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.037663 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.037872 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.037873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.037873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.038001 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.038083 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.038280 (+ 197us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.038349 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:35:59.039264 19991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.030707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57418 (local address 127.6.37.60:43043)
0924 17:35:59.030741 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.030742 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.031075 (+ 333us) server_negotiation.cc:407] Connection header received
0924 17:35:59.031164 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.031165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.031175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.031205 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.031860 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.032545 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.033558 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.033835 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.033890 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.035574 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.035576 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.035576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.035582 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.037105 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.037583 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.037584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.037584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.037642 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.037828 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.037829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.037829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.037970 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.038052 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.039095 (+ 1043us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.039184 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:35:59.039835 19838 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } attempt: 2
I20260924 17:35:59.040824 19841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.030914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56844 (local address 127.6.37.62:40719)
0924 17:35:59.030954 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.030956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.032653 (+ 1697us) server_negotiation.cc:407] Connection header received
0924 17:35:59.032745 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.032746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.032756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.032786 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.033500 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.034152 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.035218 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.035528 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.035569 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.037977 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.037978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.037978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.037985 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.039524 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.039907 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.039909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.039909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.039972 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.040203 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.040204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.040204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.040337 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.040420 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.040648 (+ 228us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.040717 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Sep 24 17:35:59 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:35:59.046507 19991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.040183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57424 (local address 127.6.37.60:43043)
0924 17:35:59.040219 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.040221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.040231 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:35:59.040264 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.040265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.040273 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.040323 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.040591 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.041266 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.041875 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.042157 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.042229 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.044113 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.044114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.044114 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.044120 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.045444 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.045832 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.045832 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.045833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.045909 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.046119 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.046120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.046120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.046204 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.046248 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.046402 (+ 154us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.046456 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:35:59.046576 19842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.040065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57424)
0924 17:35:59.040170 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:59.040180 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:59.040214 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:59.040324 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:59.040325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:59.040481 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:59.040516 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.040518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.041344 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.041345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.041798 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.041799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.042233 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.042234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.042270 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.042629 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:59.042633 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:59.044015 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:59.045536 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.045536 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.045537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.045747 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.045978 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.045979 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.045979 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.046055 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.046261 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:59.046262 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:59.046306 (+ 44us) client_negotiation.cc:769] Sending connection context
0924 17:35:59.046384 (+ 78us) client_negotiation.cc:240] Negotiation successful
0924 17:35:59.046473 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260924 17:35:59.048166 19838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: Bootstrap starting.
I20260924 17:35:59.048848 19838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:59.049134 19838 log.cc:824] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:59.049940 19838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: No bootstrap required, opened a new log
I20260924 17:35:59.051453 19838 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.051592 19838 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:59.051649 19838 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ee80d527aa4995a5b3dd1240bc1bdb, State: Initialized, Role: FOLLOWER
I20260924 17:35:59.051787 19838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.052074 19838 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:35:59.052053 20015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.052218 20015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: This master's current role is: FOLLOWER
W20260924 17:35:59.053872 20026 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:35:59.053970 20026 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:35:59.054620 19770 master_runner.cc:186] Error getting master registration for 127.6.37.61:38819: OK, instance_id { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" instance_seqno: 1790271358839047 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 17:35:59.057518 19770 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 17:35:59.074491 19913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } attempt: 3
Sep 24 17:35:59 dist-test-slave-gcz9 krb5kdc[19757](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271358, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:35:59.082980 19915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.074769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:43043 (local address 127.0.0.1:57440)
0924 17:35:59.074819 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0924 17:35:59.074829 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:35:59.074885 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:35:59.075195 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:35:59.075196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:35:59.075406 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:35:59.075479 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.075482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.076469 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.076471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.077340 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:35:59.077343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.077811 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.077812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:35:59.077892 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.078359 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:35:59.078364 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:35:59.080005 (+ 1641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:35:59.081814 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.081815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.081815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.082053 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.082268 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:35:59.082269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:35:59.082269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:35:59.082342 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:35:59.082607 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:35:59.082608 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:35:59.082656 (+ 48us) client_negotiation.cc:769] Sending connection context
0924 17:35:59.082726 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 17:35:59.082845 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260924 17:35:59.082981 19991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:35:59.074825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57440 (local address 127.6.37.60:43043)
0924 17:35:59.074881 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0924 17:35:59.074884 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:35:59.074893 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:35:59.074965 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:35:59.074966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:35:59.074976 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:35:59.075167 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:35:59.075564 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.076389 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.077435 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:35:59.077731 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:35:59.077813 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:35:59.080088 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:35:59.080090 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:35:59.080090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:35:59.080098 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:35:59.081731 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.082139 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.082140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.082141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.082197 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:35:59.082410 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:35:59.082411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:35:59.082411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:35:59.082541 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:35:59.082610 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0924 17:35:59.082760 (+ 150us) server_negotiation.cc:299] Negotiation successful
0924 17:35:59.082865 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:35:59.085031 19913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: Bootstrap starting.
I20260924 17:35:59.085803 19913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: Neither blocks nor log segments found. Creating new log.
I20260924 17:35:59.086117 19913 log.cc:824] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: Log is configured to *not* fsync() on all Append() calls
I20260924 17:35:59.087033 19913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: No bootstrap required, opened a new log
I20260924 17:35:59.089058 19913 raft_consensus.cc:348] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.089200 19913 raft_consensus.cc:374] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:35:59.089236 19913 raft_consensus.cc:729] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e79af9bab2f0446da9a6f4a9e272f11f, State: Initialized, Role: FOLLOWER
I20260924 17:35:59.089412 19913 consensus_queue.cc:260] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.089709 20029 sys_catalog.cc:455] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.089850 20029 sys_catalog.cc:458] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:35:59.089756 19913 sys_catalog.cc:564] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: configured and running, proceeding with master startup.
W20260924 17:35:59.091740 20040 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:35:59.091852 20040 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:35:59.093999 19845 master_runner.cc:263] No leader master found from master e79af9bab2f0446da9a6f4a9e272f11f
I20260924 17:35:59.094044 19845 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260924 17:35:59.191960 19791 tablet.cc:2369] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:35:59.243716 19941 tablet.cc:2369] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:35:59.256690 19999 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:35:59.256793 19999 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.257105 19999 leader_election.cc:288] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50ee80d527aa4995a5b3dd1240bc1bdb (127.6.37.62:40719), e79af9bab2f0446da9a6f4a9e272f11f (127.6.37.61:38819)
I20260924 17:35:59.257354 19812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ccf515c96c410a989cb691d76f6b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" is_pre_election: true
I20260924 17:35:59.257366 19887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ccf515c96c410a989cb691d76f6b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" is_pre_election: true
I20260924 17:35:59.257504 19812 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0ccf515c96c410a989cb691d76f6b06 in term 0.
I20260924 17:35:59.257504 19887 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0ccf515c96c410a989cb691d76f6b06 in term 0.
I20260924 17:35:59.257684 19938 leader_election.cc:302] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50ee80d527aa4995a5b3dd1240bc1bdb, c0ccf515c96c410a989cb691d76f6b06; no voters:
I20260924 17:35:59.257843 19999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:35:59.257929 19999 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:35:59.257952 19999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:59.258940 19999 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.259075 19999 leader_election.cc:288] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [CANDIDATE]: Term 1 election: Requested vote from peers 50ee80d527aa4995a5b3dd1240bc1bdb (127.6.37.62:40719), e79af9bab2f0446da9a6f4a9e272f11f (127.6.37.61:38819)
I20260924 17:35:59.259238 19887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ccf515c96c410a989cb691d76f6b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e79af9bab2f0446da9a6f4a9e272f11f"
I20260924 17:35:59.259238 19812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ccf515c96c410a989cb691d76f6b06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb"
I20260924 17:35:59.259342 19812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:59.259341 19887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:35:59.260004 19887 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0ccf515c96c410a989cb691d76f6b06 in term 1.
I20260924 17:35:59.260212 19937 leader_election.cc:302] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0ccf515c96c410a989cb691d76f6b06, e79af9bab2f0446da9a6f4a9e272f11f; no voters:
I20260924 17:35:59.260318 19999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:35:59.260311 19812 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0ccf515c96c410a989cb691d76f6b06 in term 1.
I20260924 17:35:59.260476 19999 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [term 1 LEADER]: Becoming Leader. State: Replica: c0ccf515c96c410a989cb691d76f6b06, State: Running, Role: LEADER
I20260924 17:35:59.260566 19999 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } }
I20260924 17:35:59.261020 20042 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ccf515c96c410a989cb691d76f6b06. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.261155 20042 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:59.261400 20044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:35:59.261590 20044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:35:59.262926 19887 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [term 1 FOLLOWER]: Refusing update from remote peer c0ccf515c96c410a989cb691d76f6b06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:35:59.263005 19812 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [term 1 FOLLOWER]: Refusing update from remote peer c0ccf515c96c410a989cb691d76f6b06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:35:59.263235 20042 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:35:59.263360 19999 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:35:59.264498 20015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ccf515c96c410a989cb691d76f6b06. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.264585 20015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:35:59.264539 20029 sys_catalog.cc:455] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ccf515c96c410a989cb691d76f6b06. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.264621 20029 sys_catalog.cc:458] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:35:59.265254 20042 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.265339 20042 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:59.265393 20042 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.265476 20042 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06 [sys.catalog]: This master's current role is: LEADER
I20260924 17:35:59.265573 20015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.265573 20029 sys_catalog.cc:455] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0ccf515c96c410a989cb691d76f6b06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50ee80d527aa4995a5b3dd1240bc1bdb" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40719 } } peers { permanent_uuid: "e79af9bab2f0446da9a6f4a9e272f11f" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 38819 } } peers { permanent_uuid: "c0ccf515c96c410a989cb691d76f6b06" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 43043 } } }
I20260924 17:35:59.265654 20015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:35:59.265654 20029 sys_catalog.cc:458] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:35:59.266122 20044 catalog_manager.cc:1347] Generated new cluster ID: 8fa5fb1ce84047b48cff51af5534bb10
I20260924 17:35:59.266176 20044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:35:59.287652 20044 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:35:59.288599 20044 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:35:59.293653 20044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0ccf515c96c410a989cb691d76f6b06: Generated new TSK 0
I20260924 17:35:59.293851 20044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:36:00.054459 20026 catalog_manager.cc:1259] Loaded cluster ID: 8fa5fb1ce84047b48cff51af5534bb10
I20260924 17:36:00.054536 20026 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: loading cluster ID for follower catalog manager: success
I20260924 17:36:00.055395 20026 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: acquiring CA information for follower catalog manager: success
I20260924 17:36:00.055687 20026 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 50ee80d527aa4995a5b3dd1240bc1bdb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 17:36:00.092386 20040 catalog_manager.cc:1259] Loaded cluster ID: 8fa5fb1ce84047b48cff51af5534bb10
I20260924 17:36:00.092463 20040 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: loading cluster ID for follower catalog manager: success
I20260924 17:36:00.093233 20040 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: acquiring CA information for follower catalog manager: success
I20260924 17:36:00.093494 20040 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e79af9bab2f0446da9a6f4a9e272f11f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 17:36:00.338387 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19770
I20260924 17:36:00.343477 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19845
I20260924 17:36:00.348492 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 19920
2026-09-24T17:36:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2949 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:36:00 dist-test-slave-gcz9 krb5kdc[20060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:36:00 dist-test-slave-gcz9 krb5kdc[20060](info): set up 2 sockets
Sep 24 17:36:00 dist-test-slave-gcz9 krb5kdc[20060](info): commencing operation
krb5kdc: starting...
W20260924 17:36:01.396787 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.001s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:36:01 dist-test-slave-gcz9 krb5kdc[20060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:36:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:36:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:36:01.517721 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:35935
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:35935
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:01.601743 20073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:01.601953 20073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:01.601974 20073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:01.603145 20073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:36:01.603186 20073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:01.603201 20073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:01.603261 20073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:36:01.603279 20073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:36:01.604732 20073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:35935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:35935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:01.604996 20073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:01.605242 20073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:01.610286 20078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:01.610275 20081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:01.610272 20079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:01.610569 20073 server_base.cc:1034] running on GCE node
I20260924 17:36:01.610958 20073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:01.611305 20073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:01.612462 20073 hybrid_clock.cc:648] HybridClock initialized: now 1790271361612455 us; error 36 us; skew 500 ppm
Sep 24 17:36:01 dist-test-slave-gcz9 krb5kdc[20060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271361, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:01.614849 20073 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:36:01.615300 20073 webserver.cc:460] Webserver started at http://127.6.37.62:43433/ using document root <none> and password file <none>
I20260924 17:36:01.615507 20073 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:01.615547 20073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:01.615643 20073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:01.616686 20073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "1c57e10b8bfd481d945812903be32675"
format_stamp: "Formatted at 2026-09-24 17:36:01 on dist-test-slave-gcz9"
server_key: "0850bd6680e1f6d37d99642fed2e9f25"
server_key_iv: "c5f55f2255588ee3f8c06e68b2cfdf04"
server_key_version: "encryptionkey@0"
I20260924 17:36:01.616993 20073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "1c57e10b8bfd481d945812903be32675"
format_stamp: "Formatted at 2026-09-24 17:36:01 on dist-test-slave-gcz9"
server_key: "0850bd6680e1f6d37d99642fed2e9f25"
server_key_iv: "c5f55f2255588ee3f8c06e68b2cfdf04"
server_key_version: "encryptionkey@0"
I20260924 17:36:01.618254 20073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:36:01.619004 20088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:01.619161 20073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:01.619251 20073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "1c57e10b8bfd481d945812903be32675"
format_stamp: "Formatted at 2026-09-24 17:36:01 on dist-test-slave-gcz9"
server_key: "0850bd6680e1f6d37d99642fed2e9f25"
server_key_iv: "c5f55f2255588ee3f8c06e68b2cfdf04"
server_key_version: "encryptionkey@0"
I20260924 17:36:01.619315 20073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:01.628942 20073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:01.630632 20073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:01.630738 20073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:01.634572 20073 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:35935
I20260924 17:36:01.634646 20140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:35935 every 8 connection(s)
I20260924 17:36:01.635039 20073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:36:01.635917 20141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:01.638206 20141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675: Bootstrap starting.
I20260924 17:36:01.638797 20141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:01.639109 20141 log.cc:824] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:01.639837 20141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675: No bootstrap required, opened a new log
I20260924 17:36:01.641479 20141 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c57e10b8bfd481d945812903be32675" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35935 } }
I20260924 17:36:01.641641 20141 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:01.641690 20141 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c57e10b8bfd481d945812903be32675, State: Initialized, Role: FOLLOWER
I20260924 17:36:01.641860 20141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c57e10b8bfd481d945812903be32675" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35935 } }
I20260924 17:36:01.641957 20141 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:36:01.642009 20141 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:36:01.642059 20141 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:01.642650 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20073
I20260924 17:36:01.642674 20141 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c57e10b8bfd481d945812903be32675" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35935 } }
I20260924 17:36:01.642769 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:36:01.642783 20141 leader_election.cc:302] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c57e10b8bfd481d945812903be32675; no voters:
I20260924 17:36:01.643004 6292 external_mini_cluster.cc:1428] Setting key 227a974caacbdcf957b34e05c704b50f
I20260924 17:36:01.642993 20141 leader_election.cc:288] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:36:01.643059 20144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:01.643275 20144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [term 1 LEADER]: Becoming Leader. State: Replica: 1c57e10b8bfd481d945812903be32675, State: Running, Role: LEADER
I20260924 17:36:01.643481 20144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c57e10b8bfd481d945812903be32675" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35935 } }
I20260924 17:36:01.643288 20141 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:36:01.644117 20145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c57e10b8bfd481d945812903be32675" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c57e10b8bfd481d945812903be32675" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35935 } } }
I20260924 17:36:01.644223 20145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:01.644614 20154 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:36:01.644979 20146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c57e10b8bfd481d945812903be32675. Latest consensus state: current_term: 1 leader_uuid: "1c57e10b8bfd481d945812903be32675" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c57e10b8bfd481d945812903be32675" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35935 } } }
I20260924 17:36:01.645152 20146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:01.645210 20154 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:36:01.646944 20154 catalog_manager.cc:1347] Generated new cluster ID: 83ecc8c7c78a40ab82b74f580c7088f9
I20260924 17:36:01.646996 20154 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:36:01 dist-test-slave-gcz9 krb5kdc[20060](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:01.655973 20148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:01.643533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56446 (local address 127.6.37.62:35935)
0924 17:36:01.643714 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:01.643724 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:01.643753 (+ 29us) server_negotiation.cc:407] Connection header received
0924 17:36:01.643861 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:01.643866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:01.643938 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:01.644914 (+ 976us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:01.645036 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:01.646360 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:01.647579 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:01.648195 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:01.648295 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:01.651289 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:01.651294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:01.651295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:01.651311 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:01.654091 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:01.654482 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:01.654486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:01.654486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:01.654631 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:01.654849 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:01.654850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:01.654851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:01.655250 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:01.655441 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:01.655528 (+ 87us) server_negotiation.cc:299] Negotiation successful
0924 17:36:01.655696 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260924 17:36:01.656546 20154 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:36:01.657326 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:36:01.657433 20154 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:36:01.664217 20154 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c57e10b8bfd481d945812903be32675: Generated new TSK 0
I20260924 17:36:01.664393 20154 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:36:01.711372 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20073
2026-09-24T17:36:01Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1361 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:36:01 dist-test-slave-gcz9 krb5kdc[20169](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:36:01 dist-test-slave-gcz9 krb5kdc[20169](info): set up 2 sockets
Sep 24 17:36:01 dist-test-slave-gcz9 krb5kdc[20169](info): commencing operation
krb5kdc: starting...
W20260924 17:36:02.761063 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:36:02 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:36:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:36:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:36:02.875634 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45235
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:45235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:02.955643 20182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:02.955850 20182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:02.955873 20182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:02.956955 20182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:36:02.956988 20182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:02.957008 20182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:02.957021 20182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:36:02.957033 20182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:36:02.958432 20182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:45235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:02.958616 20182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:02.958774 20182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:02.963490 20188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:02.963450 20187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:02.963671 20182 server_base.cc:1034] running on GCE node
W20260924 17:36:02.963442 20190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:02.964066 20182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:02.964463 20182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:02.965626 20182 hybrid_clock.cc:648] HybridClock initialized: now 1790271362965607 us; error 34 us; skew 500 ppm
Sep 24 17:36:02 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271362, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:02.972620 20182 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:36:02.973094 20182 webserver.cc:460] Webserver started at http://127.6.37.62:42111/ using document root <none> and password file <none>
I20260924 17:36:02.973280 20182 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:02.973320 20182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:02.973410 20182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:02.974424 20182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "707bce8c9397451f82aa819f71402188"
format_stamp: "Formatted at 2026-09-24 17:36:02 on dist-test-slave-gcz9"
server_key: "06ff1e59787bd7013679645e2f298519"
server_key_iv: "4966d715480190795a52d4e0be88f3ed"
server_key_version: "encryptionkey@0"
I20260924 17:36:02.974787 20182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "707bce8c9397451f82aa819f71402188"
format_stamp: "Formatted at 2026-09-24 17:36:02 on dist-test-slave-gcz9"
server_key: "06ff1e59787bd7013679645e2f298519"
server_key_iv: "4966d715480190795a52d4e0be88f3ed"
server_key_version: "encryptionkey@0"
I20260924 17:36:02.976145 20182 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:02.976903 20197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:02.977116 20182 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:02.977206 20182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "707bce8c9397451f82aa819f71402188"
format_stamp: "Formatted at 2026-09-24 17:36:02 on dist-test-slave-gcz9"
server_key: "06ff1e59787bd7013679645e2f298519"
server_key_iv: "4966d715480190795a52d4e0be88f3ed"
server_key_version: "encryptionkey@0"
I20260924 17:36:02.977276 20182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:02.997884 20182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.000245 20182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.000360 20182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.004917 20182 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:45235
I20260924 17:36:03.004980 20249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:45235 every 8 connection(s)
I20260924 17:36:03.005311 20182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:36:03.006295 20250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:03.008612 20250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap starting.
I20260924 17:36:03.009194 20250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:03.009487 20250 log.cc:824] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:03.010253 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20182
I20260924 17:36:03.010342 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:36:03.010331 20250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: No bootstrap required, opened a new log
I20260924 17:36:03.010542 6292 external_mini_cluster.cc:1428] Setting key 2cd534735251fd2b1c534e740503af33
I20260924 17:36:03.013028 20250 raft_consensus.cc:348] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.013181 20250 raft_consensus.cc:374] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:03.013228 20250 raft_consensus.cc:729] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707bce8c9397451f82aa819f71402188, State: Initialized, Role: FOLLOWER
I20260924 17:36:03.013381 20250 consensus_queue.cc:260] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.013460 20250 raft_consensus.cc:388] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:36:03.013504 20250 raft_consensus.cc:482] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:36:03.013551 20250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:03.014075 20250 raft_consensus.cc:504] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.014189 20250 leader_election.cc:302] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 707bce8c9397451f82aa819f71402188; no voters:
I20260924 17:36:03.014382 20250 leader_election.cc:288] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:36:03.014405 20255 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:03.014556 20255 raft_consensus.cc:686] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 LEADER]: Becoming Leader. State: Replica: 707bce8c9397451f82aa819f71402188, State: Running, Role: LEADER
I20260924 17:36:03.014631 20250 sys_catalog.cc:564] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:36:03.014675 20255 consensus_queue.cc:237] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.015046 20255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 707bce8c9397451f82aa819f71402188. Latest consensus state: current_term: 1 leader_uuid: "707bce8c9397451f82aa819f71402188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } } }
I20260924 17:36:03.015060 20256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "707bce8c9397451f82aa819f71402188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } } }
I20260924 17:36:03.015295 20256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:03.016168 20255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: This master's current role is: LEADER
W20260924 17:36:03.016402 20271 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:36:03.016448 20271 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:36:03.016507 20264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:36:03.016670 20264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:36:03.018153 20264 catalog_manager.cc:1347] Generated new cluster ID: c9aef05591004fa2aa07b4597d8195fb
I20260924 17:36:03.018206 20264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:03.022202 20254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.011087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58820 (local address 127.6.37.62:45235)
0924 17:36:03.011255 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.011263 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.011290 (+ 27us) server_negotiation.cc:407] Connection header received
0924 17:36:03.011891 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.011899 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.011947 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.012068 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.012928 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.014197 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.015462 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.016100 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.016212 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.019058 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.019062 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.019062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.019073 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.020731 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.021095 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.021099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.021099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.021183 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.021383 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.021384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.021384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.021612 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.021772 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.021888 (+ 116us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.022032 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":85,"threads_started":1}
I20260924 17:36:03.026324 20264 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:36:03.027096 20264 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:36:03.030797 20264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Generated new TSK 0
I20260924 17:36:03.030992 20264 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:36:03.057252 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:45235
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:03.138692 20276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:03.138926 20276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:03.138964 20276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:03.140100 20276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:03.140161 20276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:03.140208 20276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:36:03.141647 20276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:03.141906 20276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:03.142123 20276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:03.147513 20284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.147578 20276 server_base.cc:1034] running on GCE node
W20260924 17:36:03.147557 20282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.147541 20281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.147902 20276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:03.148115 20276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:03.149255 20276 hybrid_clock.cc:648] HybridClock initialized: now 1790271363149241 us; error 29 us; skew 500 ppm
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:03.151840 20276 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:36:03.152230 20276 webserver.cc:460] Webserver started at http://127.6.37.1:43889/ using document root <none> and password file <none>
I20260924 17:36:03.152456 20276 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:03.152524 20276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:03.152664 20276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:03.153671 20276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "27cc27676c1845acbf2115f6e32dd628"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "bcda72fc6df8c4da446c23b58eff27ac"
server_key_iv: "53593214652658e1f16dbf56ca6cc1ab"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.154024 20276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "27cc27676c1845acbf2115f6e32dd628"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "bcda72fc6df8c4da446c23b58eff27ac"
server_key_iv: "53593214652658e1f16dbf56ca6cc1ab"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.155443 20276 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:36:03.156181 20291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.156369 20276 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:36:03.156471 20276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "27cc27676c1845acbf2115f6e32dd628"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "bcda72fc6df8c4da446c23b58eff27ac"
server_key_iv: "53593214652658e1f16dbf56ca6cc1ab"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.156543 20276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:03.175773 20276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.177690 20276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.177840 20276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.178064 20276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:03.178359 20276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:03.178411 20276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.178455 20276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:03.178490 20276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.184863 20276 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:35951
I20260924 17:36:03.184900 20406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:35951 every 8 connection(s)
I20260924 17:36:03.185235 20276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:03.192178 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20276
I20260924 17:36:03.192293 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:36:03.192512 6292 external_mini_cluster.cc:1428] Setting key 96f058d647d2eef06e46099fa4d50d86
I20260924 17:36:03.194759 20254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.186019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:49045 (local address 127.6.37.62:45235)
0924 17:36:03.186065 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.186067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.186287 (+ 220us) server_negotiation.cc:407] Connection header received
0924 17:36:03.186812 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.186813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.186826 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.186893 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.187819 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.188338 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.189344 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.189562 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.189634 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.191706 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.191707 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.191707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.191715 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.193397 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.193803 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.193805 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.193805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.193861 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.194113 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.194114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.194114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.194227 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.194298 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.194588 (+ 290us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.194671 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:36:03.194962 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.185998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:49045)
0924 17:36:03.186172 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.186206 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.186710 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.186964 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.186968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.187525 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:03.187715 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.187721 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.188439 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.188440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.189242 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.189245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.189643 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.189644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.189773 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.190214 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:03.190223 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:03.191606 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:03.193484 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.193492 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.193494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.193717 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.193929 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.193930 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.193930 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.194041 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.194290 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:03.194296 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:03.194448 (+ 152us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.194555 (+ 107us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.194711 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":92,"threads_started":1}
I20260924 17:36:03.195483 20407 heartbeater.cc:347] Connected to a master server at 127.6.37.62:45235
I20260924 17:36:03.195574 20407 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:03.195765 20407 heartbeater.cc:511] Master 127.6.37.62:45235 requested a full tablet report, sending...
I20260924 17:36:03.196273 20214 ts_manager.cc:194] Registered new tserver with Master: 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951)
I20260924 17:36:03.196874 20214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:49045
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:36:03.217453 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:45235
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:03.297657 20412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:03.297850 20412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:03.297874 20412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:03.299012 20412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:03.299050 20412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:03.299077 20412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:36:03.300519 20412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:03.300752 20412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:03.300969 20412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:03.305886 20418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.305936 20412 server_base.cc:1034] running on GCE node
W20260924 17:36:03.305876 20417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.305860 20420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.306267 20412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:03.306474 20412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:03.307613 20412 hybrid_clock.cc:648] HybridClock initialized: now 1790271363307595 us; error 34 us; skew 500 ppm
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:03.310025 20412 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:36:03.310443 20412 webserver.cc:460] Webserver started at http://127.6.37.2:41059/ using document root <none> and password file <none>
I20260924 17:36:03.310634 20412 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:03.310673 20412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:03.310760 20412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:03.311941 20412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "3c5348ae23494ef8aae81e1a140301af"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "29d1a8910a177a5865e7c0423576cd0b"
server_key_iv: "a9bd4b05cc1e64da8fe894cc5f060ecd"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.312254 20412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "3c5348ae23494ef8aae81e1a140301af"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "29d1a8910a177a5865e7c0423576cd0b"
server_key_iv: "a9bd4b05cc1e64da8fe894cc5f060ecd"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.313540 20412 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:36:03.314332 20427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.314481 20412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:03.314571 20412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "3c5348ae23494ef8aae81e1a140301af"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "29d1a8910a177a5865e7c0423576cd0b"
server_key_iv: "a9bd4b05cc1e64da8fe894cc5f060ecd"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.314627 20412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:03.321991 20412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.323870 20412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.323975 20412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.324136 20412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:03.324371 20412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:03.324402 20412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.324424 20412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:03.324436 20412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.330034 20412 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:40267
I20260924 17:36:03.330137 20541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:40267 every 8 connection(s)
I20260924 17:36:03.330402 20412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:36:03.331916 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20412
I20260924 17:36:03.332013 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:36:03.332226 6292 external_mini_cluster.cc:1428] Setting key 03fb82bb203d50724fcdea681f5ce721
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
I20260924 17:36:03.341153 20254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.331161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:34909 (local address 127.6.37.62:45235)
0924 17:36:03.331212 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.331215 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.331406 (+ 191us) server_negotiation.cc:407] Connection header received
0924 17:36:03.332090 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.332092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.332105 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.332142 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.333665 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.334148 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.335400 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.335726 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.335800 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.338081 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.338083 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.338083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.338091 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.339738 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.340160 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.340161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.340161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.340224 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.340474 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.340475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.340475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.340616 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.340686 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.340982 (+ 296us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.341064 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:36:03.341316 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.331144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:34909)
0924 17:36:03.331302 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.331340 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.331944 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.332401 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.332409 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.333275 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:03.333554 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.333561 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.334244 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.334245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.335313 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.335316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.335851 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.335852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.335959 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.336481 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:03.336503 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:03.337979 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:03.339856 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.339863 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.339864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.340077 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.340302 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.340302 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.340303 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.340405 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.340681 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:03.340686 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:03.340802 (+ 116us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.340941 (+ 139us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.341098 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":88,"threads_started":1}
I20260924 17:36:03.341771 20542 heartbeater.cc:347] Connected to a master server at 127.6.37.62:45235
I20260924 17:36:03.341884 20542 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:03.342077 20542 heartbeater.cc:511] Master 127.6.37.62:45235 requested a full tablet report, sending...
I20260924 17:36:03.342458 20214 ts_manager.cc:194] Registered new tserver with Master: 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
I20260924 17:36:03.342831 20214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:34909
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:36:03.357909 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:45235
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:03.442602 20547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:03.442797 20547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:03.442824 20547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:03.444000 20547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:03.444041 20547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:03.444067 20547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:36:03.445511 20547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20547
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:03.445739 20547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:03.445963 20547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:03.450798 20555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.450762 20553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.450773 20552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.451216 20547 server_base.cc:1034] running on GCE node
I20260924 17:36:03.451390 20547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:03.451574 20547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:03.452704 20547 hybrid_clock.cc:648] HybridClock initialized: now 1790271363452693 us; error 29 us; skew 500 ppm
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:03.455123 20547 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:36:03.455535 20547 webserver.cc:460] Webserver started at http://127.6.37.3:41869/ using document root <none> and password file <none>
I20260924 17:36:03.455749 20547 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:03.455814 20547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:03.455946 20547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:03.456940 20547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "513cd54c397f472c862f8b855e639224"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "b584661f14dc1bedd241fbebd8724d3e"
server_key_iv: "34b529cbe981899330e658daa75b1bce"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.457284 20547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "513cd54c397f472c862f8b855e639224"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "b584661f14dc1bedd241fbebd8724d3e"
server_key_iv: "34b529cbe981899330e658daa75b1bce"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.458539 20547 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:36:03.459296 20562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.459481 20547 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.459584 20547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "513cd54c397f472c862f8b855e639224"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "b584661f14dc1bedd241fbebd8724d3e"
server_key_iv: "34b529cbe981899330e658daa75b1bce"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.459661 20547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:03.470624 20547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.472402 20547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.472561 20547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.472790 20547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:03.473100 20547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:03.473152 20547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.473193 20547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:03.473219 20547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.479395 20547 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:35417
I20260924 17:36:03.479462 20676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:35417 every 8 connection(s)
I20260924 17:36:03.479839 20547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:36:03.482486 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20547
I20260924 17:36:03.482583 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:36:03.482746 6292 external_mini_cluster.cc:1428] Setting key 9fae4c353ef631c7f86bd1c1f2586714
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:03.489051 20254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.480633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:43029 (local address 127.6.37.62:45235)
0924 17:36:03.480685 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.480688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.480919 (+ 231us) server_negotiation.cc:407] Connection header received
0924 17:36:03.481387 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.481389 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.481399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.481451 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.482337 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.482993 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.484243 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.484575 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.484642 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.486577 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.486579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.486579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.486586 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.487940 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.488282 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.488283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.488283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.488331 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.488549 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.488549 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.488550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.488643 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.488692 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.488920 (+ 228us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.488979 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:36:03.489367 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.480630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:43029)
0924 17:36:03.480799 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.480836 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.481300 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.481502 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.481505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.482054 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:03.482244 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.482248 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.483090 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.483091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.484172 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.484175 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.484655 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.484656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.484761 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.485199 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:03.485206 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:03.486497 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:03.488013 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.488019 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.488020 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.488222 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.488399 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.488399 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.488400 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.488496 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.488694 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:03.488699 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:03.488807 (+ 108us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.488900 (+ 93us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.489016 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260924 17:36:03.489899 20677 heartbeater.cc:347] Connected to a master server at 127.6.37.62:45235
I20260924 17:36:03.490010 20677 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:03.490190 20677 heartbeater.cc:511] Master 127.6.37.62:45235 requested a full tablet report, sending...
I20260924 17:36:03.490540 20214 ts_manager.cc:194] Registered new tserver with Master: 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417)
I20260924 17:36:03.490998 20214 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:43029
I20260924 17:36:03.494570 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:36:03.501564 20254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.495942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58822 (local address 127.6.37.62:45235)
0924 17:36:03.495980 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.495981 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.496115 (+ 134us) server_negotiation.cc:407] Connection header received
0924 17:36:03.496190 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.496191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.496201 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.496250 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.496807 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.497272 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.497994 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.498188 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.498269 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.499405 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.499407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.499407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.499414 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.500463 (+ 1049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.500797 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.500798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.500799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.500855 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.501040 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.501041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.501042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.501183 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.501282 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.501392 (+ 110us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.501469 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:36:03.503024 20214 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58822:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:36:03.504555 20214 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:36:03.510967 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.506803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35417 (local address 127.0.0.1:56488)
0924 17:36:03.507261 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.507272 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.507322 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.507570 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.507571 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.507573 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.507618 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.507620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.508441 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.508442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.509707 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.509710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.510622 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.510623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.510739 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.510758 (+ 19us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.510830 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.510901 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":96,"threads_started":1}
I20260924 17:36:03.511013 20690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.507022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56488 (local address 127.6.37.3:35417)
0924 17:36:03.507206 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.507210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.507374 (+ 164us) server_negotiation.cc:407] Connection header received
0924 17:36:03.507411 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.507413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.507427 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.507497 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.507694 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.508344 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.509783 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.510531 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.510610 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.510669 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.510848 (+ 179us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.510922 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":77,"threads_started":1}
I20260924 17:36:03.511195 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.506620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:35951 (local address 127.0.0.1:40000)
0924 17:36:03.507062 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.507070 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.507112 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.507356 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.507357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.507358 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.507401 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.507403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.508726 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.508727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.509776 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.509778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.510937 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.510938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.511007 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.511012 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.511070 (+ 58us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.511119 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":1,"thread_start_us":53,"threads_started":1}
I20260924 17:36:03.511416 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.506825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40000 (local address 127.6.37.1:35951)
0924 17:36:03.507018 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.507023 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.507122 (+ 99us) server_negotiation.cc:407] Connection header received
0924 17:36:03.507171 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.507173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.507187 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.507278 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.507485 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.508613 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.509851 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.510544 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.510610 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.510669 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.511298 (+ 629us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.511342 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":113,"threads_started":1}
I20260924 17:36:03.511715 20610 tablet_service.cc:1467] Processing CreateTablet for tablet 4a69cf6692db4671b12d5a507e5775e1 (DEFAULT_TABLE table=test-table [id=5ddaba93b8a742dd868156732fe10b9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:03.512091 20610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a69cf6692db4671b12d5a507e5775e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:03.512121 20340 tablet_service.cc:1467] Processing CreateTablet for tablet 4a69cf6692db4671b12d5a507e5775e1 (DEFAULT_TABLE table=test-table [id=5ddaba93b8a742dd868156732fe10b9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:03.512274 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.506620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40267 (local address 127.0.0.1:45880)
0924 17:36:03.506826 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.506888 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.506954 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.507275 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.507278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.507280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.507409 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.507411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.509862 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.509863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.510622 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.510624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.512036 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.512037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.512105 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.512109 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.512170 (+ 61us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.512212 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":50,"threads_started":1}
I20260924 17:36:03.512332 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.506726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45880 (local address 127.6.37.2:40267)
0924 17:36:03.507077 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.507083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.507094 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:36:03.507137 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.507139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.507155 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.507254 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.507495 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.508619 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.510720 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.511866 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.511934 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.511999 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.512205 (+ 206us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.512254 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":96,"threads_started":1}
I20260924 17:36:03.512449 20340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a69cf6692db4671b12d5a507e5775e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:03.514561 20691 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Bootstrap starting.
I20260924 17:36:03.515287 20691 tablet_bootstrap.cc:654] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:03.515416 20692 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap starting.
I20260924 17:36:03.515647 20475 tablet_service.cc:1467] Processing CreateTablet for tablet 4a69cf6692db4671b12d5a507e5775e1 (DEFAULT_TABLE table=test-table [id=5ddaba93b8a742dd868156732fe10b9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:03.515892 20691 log.cc:824] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:03.516022 20475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a69cf6692db4671b12d5a507e5775e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:03.516247 20692 tablet_bootstrap.cc:654] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:03.516634 20691 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: No bootstrap required, opened a new log
I20260924 17:36:03.516717 20691 ts_tablet_manager.cc:1397] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:36:03.516835 20692 log.cc:824] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:03.517673 20692 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: No bootstrap required, opened a new log
I20260924 17:36:03.517745 20692 ts_tablet_manager.cc:1397] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:03.518682 20691 raft_consensus.cc:348] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.518836 20691 raft_consensus.cc:374] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:03.518898 20691 raft_consensus.cc:729] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 513cd54c397f472c862f8b855e639224, State: Initialized, Role: FOLLOWER
I20260924 17:36:03.519012 20691 consensus_queue.cc:260] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.519327 20677 heartbeater.cc:503] Master 127.6.37.62:45235 was elected leader, sending a full tablet report...
I20260924 17:36:03.519317 20691 ts_tablet_manager.cc:1428] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260924 17:36:03.519826 20696 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Bootstrap starting.
I20260924 17:36:03.519886 20692 raft_consensus.cc:348] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.520071 20692 raft_consensus.cc:374] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:03.520123 20692 raft_consensus.cc:729] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27cc27676c1845acbf2115f6e32dd628, State: Initialized, Role: FOLLOWER
I20260924 17:36:03.520243 20692 consensus_queue.cc:260] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.520467 20696 tablet_bootstrap.cc:654] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:03.520541 20407 heartbeater.cc:503] Master 127.6.37.62:45235 was elected leader, sending a full tablet report...
I20260924 17:36:03.520555 20692 ts_tablet_manager.cc:1428] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:36:03.521037 20696 log.cc:824] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:03.521842 20696 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: No bootstrap required, opened a new log
I20260924 17:36:03.521896 20696 ts_tablet_manager.cc:1397] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:03.523464 20696 raft_consensus.cc:348] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.523600 20696 raft_consensus.cc:374] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:03.523622 20696 raft_consensus.cc:729] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c5348ae23494ef8aae81e1a140301af, State: Initialized, Role: FOLLOWER
I20260924 17:36:03.523725 20696 consensus_queue.cc:260] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.523944 20696 ts_tablet_manager.cc:1428] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:03.524020 20542 heartbeater.cc:503] Master 127.6.37.62:45235 was elected leader, sending a full tablet report...
I20260924 17:36:03.538563 20697 raft_consensus.cc:482] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:03.538715 20697 raft_consensus.cc:504] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.539109 20697 leader_election.cc:288] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267), 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417)
I20260924 17:36:03.541715 20695 raft_consensus.cc:482] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:03.541833 20695 raft_consensus.cc:504] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.542490 20695 leader_election.cc:288] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267), 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951)
I20260924 17:36:03.543007 20409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.539269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40267 (local address 127.6.37.1:42819)
0924 17:36:03.539345 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.539355 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.539420 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.539580 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.539581 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.539583 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.539661 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.539663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.540611 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.540613 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.541926 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.541931 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.542695 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.542696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.542790 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.542794 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.542843 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.542908 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":80}
I20260924 17:36:03.543054 20690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.539464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:50185 (local address 127.6.37.3:35417)
0924 17:36:03.539511 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.539514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.539639 (+ 125us) server_negotiation.cc:407] Connection header received
0924 17:36:03.539671 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.539671 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.539681 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.539742 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.539873 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.540556 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.542108 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.542659 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.542715 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.542723 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.542921 (+ 198us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.542972 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:36:03.543263 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.539360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:42819 (local address 127.6.37.2:40267)
0924 17:36:03.539413 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.539416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.539426 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:36:03.539485 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.539486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.539512 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.539569 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.539737 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.540505 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.541993 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.542590 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.542662 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.542674 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.543154 (+ 480us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.543202 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260924 17:36:03.543306 20700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.539378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35417 (local address 127.6.37.1:50185)
0924 17:36:03.539547 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.539556 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.539605 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.539754 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.539755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.539756 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.539808 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.539809 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.540627 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.540628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.542014 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.542019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.542723 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.542724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.542805 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.542810 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.543167 (+ 357us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.543222 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":45,"thread_start_us":88,"threads_started":1}
I20260924 17:36:03.543529 20495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a69cf6692db4671b12d5a507e5775e1" candidate_uuid: "27cc27676c1845acbf2115f6e32dd628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c5348ae23494ef8aae81e1a140301af" is_pre_election: true
I20260924 17:36:03.543576 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a69cf6692db4671b12d5a507e5775e1" candidate_uuid: "27cc27676c1845acbf2115f6e32dd628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "513cd54c397f472c862f8b855e639224" is_pre_election: true
I20260924 17:36:03.543645 20495 raft_consensus.cc:2454] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27cc27676c1845acbf2115f6e32dd628 in term 0.
I20260924 17:36:03.543675 20630 raft_consensus.cc:2454] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27cc27676c1845acbf2115f6e32dd628 in term 0.
I20260924 17:36:03.543855 20292 leader_election.cc:302] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628, 513cd54c397f472c862f8b855e639224; no voters:
I20260924 17:36:03.543968 20697 raft_consensus.cc:2781] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:36:03.544005 20697 raft_consensus.cc:482] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:36:03.544025 20697 raft_consensus.cc:3037] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:03.544916 20697 raft_consensus.cc:504] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.545039 20697 leader_election.cc:288] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 1 election: Requested vote from peers 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267), 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417)
I20260924 17:36:03.545233 20495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a69cf6692db4671b12d5a507e5775e1" candidate_uuid: "27cc27676c1845acbf2115f6e32dd628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c5348ae23494ef8aae81e1a140301af"
I20260924 17:36:03.545260 20630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a69cf6692db4671b12d5a507e5775e1" candidate_uuid: "27cc27676c1845acbf2115f6e32dd628" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "513cd54c397f472c862f8b855e639224"
I20260924 17:36:03.545307 20495 raft_consensus.cc:3037] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:03.545327 20630 raft_consensus.cc:3037] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:03.545780 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.542298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:35951 (local address 127.6.37.3:56949)
0924 17:36:03.542380 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.542391 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.542430 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.542843 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.542844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.542846 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.542930 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.542932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.543754 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.543755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.544812 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.544815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.545543 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.545545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.545616 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.545621 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.545668 (+ 47us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.545718 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":1}
I20260924 17:36:03.545951 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.542663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:56949 (local address 127.6.37.1:35951)
0924 17:36:03.542701 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.542703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.542710 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:36:03.542727 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.542728 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.542736 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.542787 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.543003 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.543648 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.544913 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.545433 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.545501 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.545510 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.545860 (+ 350us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.545897 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:36:03.546198 20630 raft_consensus.cc:2454] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27cc27676c1845acbf2115f6e32dd628 in term 1.
I20260924 17:36:03.546293 20495 raft_consensus.cc:2454] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27cc27676c1845acbf2115f6e32dd628 in term 1.
I20260924 17:36:03.546316 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.542507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:42647 (local address 127.6.37.2:40267)
0924 17:36:03.542644 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.542646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.542911 (+ 265us) server_negotiation.cc:407] Connection header received
0924 17:36:03.542978 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.542979 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.542987 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.543056 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.543236 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.544059 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.545304 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.545883 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.545956 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.545967 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.546182 (+ 215us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.546230 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260924 17:36:03.546383 20292 leader_election.cc:302] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628, 513cd54c397f472c862f8b855e639224; no voters:
I20260924 17:36:03.546475 20697 raft_consensus.cc:2781] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:03.546483 20360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a69cf6692db4671b12d5a507e5775e1" candidate_uuid: "513cd54c397f472c862f8b855e639224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27cc27676c1845acbf2115f6e32dd628" is_pre_election: true
I20260924 17:36:03.546640 20697 raft_consensus.cc:686] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 LEADER]: Becoming Leader. State: Replica: 27cc27676c1845acbf2115f6e32dd628, State: Running, Role: LEADER
I20260924 17:36:03.546712 20697 consensus_queue.cc:237] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.546769 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.542298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40267 (local address 127.6.37.3:42647)
0924 17:36:03.542790 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.542801 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.542849 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.543098 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.543098 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.543100 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.543161 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.543163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.544149 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.544150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.545216 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.545219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.546016 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.546017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.546097 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.546102 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.546164 (+ 62us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.546204 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":70,"thread_start_us":79,"threads_started":1}
I20260924 17:36:03.547058 20495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a69cf6692db4671b12d5a507e5775e1" candidate_uuid: "513cd54c397f472c862f8b855e639224" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c5348ae23494ef8aae81e1a140301af" is_pre_election: true
I20260924 17:36:03.547163 20495 raft_consensus.cc:2379] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 513cd54c397f472c862f8b855e639224 in current term 1: Already voted for candidate 27cc27676c1845acbf2115f6e32dd628 in this term.
I20260924 17:36:03.547524 20563 leader_election.cc:302] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 513cd54c397f472c862f8b855e639224; no voters: 27cc27676c1845acbf2115f6e32dd628, 3c5348ae23494ef8aae81e1a140301af
I20260924 17:36:03.547704 20695 raft_consensus.cc:2726] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260924 17:36:03.547665 20214 catalog_manager.cc:5495] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1). New cstate: current_term: 1 leader_uuid: "27cc27676c1845acbf2115f6e32dd628" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260924 17:36:03.555398 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.553060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40012 (local address 127.6.37.1:35951)
0924 17:36:03.553111 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.553112 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.553120 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:36:03.553191 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.553191 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.553206 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.553264 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:36:03.553364 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.553784 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.554616 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.554793 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.554858 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.555066 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:36:03.555156 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:36:03.555217 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.555271 (+ 54us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.555286 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260924 17:36:03.557169 20495 raft_consensus.cc:1261] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Refusing update from remote peer 27cc27676c1845acbf2115f6e32dd628: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:03.557192 20630 raft_consensus.cc:1261] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Refusing update from remote peer 27cc27676c1845acbf2115f6e32dd628: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:03.557536 20697 consensus_queue.cc:1035] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:03.557657 20703 consensus_queue.cc:1035] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:03.560659 20706 mvcc.cc:205] Tried to move back new op lower bound from 7332951505127546880 to 7332951505088061440. Current Snapshot: MvccSnapshot[applied={T|T < 7332951505127546880 or (T in {7332951505127546880})}]
I20260924 17:36:03.560945 20708 mvcc.cc:205] Tried to move back new op lower bound from 7332951505127546880 to 7332951505088061440. Current Snapshot: MvccSnapshot[applied={T|T < 7332951505127546880}]
I20260924 17:36:03.562978 20214 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:03.563092 20214 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58822:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:03.563902 20214 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Sending DeleteTablet for 3 replicas of tablet 4a69cf6692db4671b12d5a507e5775e1
I20260924 17:36:03.564241 20475 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a69cf6692db4671b12d5a507e5775e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:03 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:45880
I20260924 17:36:03.564314 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20276
I20260924 17:36:03.564307 20610 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a69cf6692db4671b12d5a507e5775e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:03 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:56488
I20260924 17:36:03.565040 20717 tablet_replica.cc:330] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: stopping tablet replica
I20260924 17:36:03.565078 20716 tablet_replica.cc:330] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: stopping tablet replica
I20260924 17:36:03.565172 20716 raft_consensus.cc:2229] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:03.565196 20717 raft_consensus.cc:2229] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:03.565281 20716 raft_consensus.cc:2258] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:03.565424 20717 raft_consensus.cc:2258] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:03.565768 20716 ts_tablet_manager.cc:1905] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:03.565940 20717 ts_tablet_manager.cc:1905] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:03.567564 20716 ts_tablet_manager.cc:1918] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:03.567610 20717 ts_tablet_manager.cc:1918] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:03.567653 20716 log.cc:1196] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/4a69cf6692db4671b12d5a507e5775e1
I20260924 17:36:03.567695 20717 log.cc:1196] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/4a69cf6692db4671b12d5a507e5775e1
I20260924 17:36:03.568053 20716 ts_tablet_manager.cc:1939] T 4a69cf6692db4671b12d5a507e5775e1 P 3c5348ae23494ef8aae81e1a140301af: Deleting consensus metadata
I20260924 17:36:03.568147 20717 ts_tablet_manager.cc:1939] T 4a69cf6692db4671b12d5a507e5775e1 P 513cd54c397f472c862f8b855e639224: Deleting consensus metadata
I20260924 17:36:03.568601 20198 catalog_manager.cc:4841] TS 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): tablet 4a69cf6692db4671b12d5a507e5775e1 (table test-table [id=5ddaba93b8a742dd868156732fe10b9a]) successfully deleted
I20260924 17:36:03.568730 20198 catalog_manager.cc:4841] TS 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): tablet 4a69cf6692db4671b12d5a507e5775e1 (table test-table [id=5ddaba93b8a742dd868156732fe10b9a]) successfully deleted
W20260924 17:36:03.570803 20199 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:35951 (error 108)
I20260924 17:36:03.571084 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20412
I20260924 17:36:03.571667 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.571174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:35951 (local address 127.0.0.1:40018)
0924 17:36:03.571587 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.571626 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:35951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392}
W20260924 17:36:03.575388 20199 catalog_manager.cc:4584] TS 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a69cf6692db4671b12d5a507e5775e1: Network error: Client connection negotiation failed: client connection to 127.6.37.1:35951: connect: Connection refused (error 111)
I20260924 17:36:03.577502 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20547
I20260924 17:36:03.582412 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20182
I20260924 17:36:03.587738 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45235
--webserver_interface=127.6.37.62
--webserver_port=42111
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:45235
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:03.669456 20719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:03.669660 20719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:03.669682 20719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:03.670763 20719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:36:03.670802 20719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:03.670816 20719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:03.670828 20719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:36:03.670840 20719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:36:03.672369 20719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:45235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=42111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:03.672551 20719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:03.672730 20719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:03.681293 20725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.681501 20719 server_base.cc:1034] running on GCE node
W20260924 17:36:03.681294 20728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.681317 20726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.681862 20719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:03.682179 20719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:03.683320 20719 hybrid_clock.cc:648] HybridClock initialized: now 1790271363683308 us; error 28 us; skew 500 ppm
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:03.685863 20719 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:36:03.686228 20719 webserver.cc:460] Webserver started at http://127.6.37.62:42111/ using document root <none> and password file <none>
I20260924 17:36:03.686425 20719 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:03.686475 20719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:03.688093 20719 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:03.688987 20735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.689177 20719 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:03.689285 20719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "707bce8c9397451f82aa819f71402188"
format_stamp: "Formatted at 2026-09-24 17:36:02 on dist-test-slave-gcz9"
server_key: "06ff1e59787bd7013679645e2f298519"
server_key_iv: "4966d715480190795a52d4e0be88f3ed"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.689859 20719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:03.699832 20719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.701651 20719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.701790 20719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.705647 20719 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:45235
I20260924 17:36:03.705694 20787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:45235 every 8 connection(s)
I20260924 17:36:03.706048 20719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:36:03.707700 20788 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:36:03.708388 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap starting.
I20260924 17:36:03.712550 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20719
I20260924 17:36:03.712836 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:35951
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:45235
--webserver_port=43889
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:36:03.716918 20788 log.cc:824] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:03.718725 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:36:03.719045 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap complete.
I20260924 17:36:03.721339 20788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.721580 20788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707bce8c9397451f82aa819f71402188, State: Initialized, Role: FOLLOWER
I20260924 17:36:03.721767 20788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.721860 20788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:36:03.721920 20788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:36:03.721993 20788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 1 FOLLOWER]: Advancing to term 2
I20260924 17:36:03.723016 20788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.723126 20788 leader_election.cc:302] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 707bce8c9397451f82aa819f71402188; no voters:
I20260924 17:36:03.723290 20788 leader_election.cc:288] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 17:36:03.723366 20792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Leader election won for term 2
I20260924 17:36:03.723477 20792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 LEADER]: Becoming Leader. State: Replica: 707bce8c9397451f82aa819f71402188, State: Running, Role: LEADER
I20260924 17:36:03.723572 20792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:03.723603 20788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:36:03.723857 20793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "707bce8c9397451f82aa819f71402188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } } }
I20260924 17:36:03.723950 20793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:03.724095 20794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 707bce8c9397451f82aa819f71402188. Latest consensus state: current_term: 2 leader_uuid: "707bce8c9397451f82aa819f71402188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } } }
I20260924 17:36:03.724151 20794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:03.724226 20796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:36:03.725260 20796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:36:03.725433 20796 catalog_manager.cc:1259] Loaded cluster ID: c9aef05591004fa2aa07b4597d8195fb
I20260924 17:36:03.725646 20796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:36:03.725891 20796 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260924 17:36:03.728731 20796 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260924 17:36:03.735947 20796 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:36:03.736155 20796 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Loaded TSK: 0
I20260924 17:36:03.736390 20796 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 17:36:03.805866 20790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:03.806071 20790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:03.806093 20790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:03.807247 20790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:03.807312 20790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:03.807358 20790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:36:03.808799 20790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:35951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=43889
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:03.809057 20790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:03.809274 20790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:03.814195 20816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.814199 20818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.814251 20815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.814440 20790 server_base.cc:1034] running on GCE node
I20260924 17:36:03.814721 20790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:03.814994 20790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:03.816149 20790 hybrid_clock.cc:648] HybridClock initialized: now 1790271363816120 us; error 47 us; skew 500 ppm
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:03.819249 20790 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:36:03.819767 20790 webserver.cc:460] Webserver started at http://127.6.37.1:43889/ using document root <none> and password file <none>
I20260924 17:36:03.820029 20790 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:03.820111 20790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:03.821841 20790 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 17:36:03.822651 20825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.822831 20790 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:03.822948 20790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "27cc27676c1845acbf2115f6e32dd628"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "bcda72fc6df8c4da446c23b58eff27ac"
server_key_iv: "53593214652658e1f16dbf56ca6cc1ab"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.823292 20790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:03.835796 20790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.837975 20790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.838124 20790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.838361 20790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:03.838798 20832 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260924 17:36:03.840746 20790 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260924 17:36:03.840803 20790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260924 17:36:03.840857 20790 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260924 17:36:03.841499 20790 ts_tablet_manager.cc:610] Registered 1 tablets
I20260924 17:36:03.841552 20790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260924 17:36:03.841641 20832 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap starting.
I20260924 17:36:03.848738 20790 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:35951
I20260924 17:36:03.849099 20790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:36:03.851070 20942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:35951 every 8 connection(s)
I20260924 17:36:03.852906 20832 log.cc:824] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:03.855489 20832 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:36:03.855789 20832 tablet_bootstrap.cc:492] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap complete.
I20260924 17:36:03.857049 20832 ts_tablet_manager.cc:1397] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260924 17:36:03.858063 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20790
I20260924 17:36:03.858335 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:40267
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:45235
--webserver_port=41059
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:36:03.858355 20832 raft_consensus.cc:348] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.858649 20832 raft_consensus.cc:729] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27cc27676c1845acbf2115f6e32dd628, State: Initialized, Role: FOLLOWER
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:03.858794 20832 consensus_queue.cc:260] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:03.859076 20832 ts_tablet_manager.cc:1428] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20260924 17:36:03.862874 20945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.849763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:54933)
0924 17:36:03.849942 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.849984 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.850404 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.853621 (+ 3217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.853626 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.853892 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:03.854072 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.854077 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.855304 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.855305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.856241 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.856244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.856833 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.856835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.856977 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.857507 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:03.857516 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:03.859337 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:03.861319 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.861326 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.861328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.861548 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.861793 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.861794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.861795 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.861904 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.862261 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:03.862268 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:03.862404 (+ 136us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.862509 (+ 105us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.862681 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":108,"threads_started":1}
I20260924 17:36:03.862912 20946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.849845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:54933 (local address 127.6.37.62:45235)
0924 17:36:03.853148 (+ 3303us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.853159 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.853206 (+ 47us) server_negotiation.cc:407] Connection header received
0924 17:36:03.853347 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.853354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.853417 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.853577 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.854186 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.855195 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.856332 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.856728 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.856864 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.859484 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.859489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.859490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.859503 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.861202 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.861631 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.861634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.861634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.861725 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.861974 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.861975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.861976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.862190 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.862281 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.862566 (+ 285us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.862686 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3234,"thread_start_us":105,"threads_started":1}
I20260924 17:36:03.863523 20943 heartbeater.cc:347] Connected to a master server at 127.6.37.62:45235
I20260924 17:36:03.863627 20943 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:03.863801 20943 heartbeater.cc:511] Master 127.6.37.62:45235 requested a full tablet report, sending...
I20260924 17:36:03.864477 20752 ts_manager.cc:194] Registered new tserver with Master: 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951)
I20260924 17:36:03.865483 20752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:54933
I20260924 17:36:03.866341 20943 heartbeater.cc:503] Master 127.6.37.62:45235 was elected leader, sending a full tablet report...
I20260924 17:36:03.869863 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.865762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40030 (local address 127.6.37.1:35951)
0924 17:36:03.865892 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.865897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.867060 (+ 1163us) server_negotiation.cc:407] Connection header received
0924 17:36:03.867165 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.867167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.867181 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.867269 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:03.867400 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.868025 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.869014 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.869465 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.869556 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.869609 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.869764 (+ 155us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.869800 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260924 17:36:03.869866 20950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.865016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:35951 (local address 127.0.0.1:40030)
0924 17:36:03.866970 (+ 1954us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.866997 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.867078 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.867275 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.867278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.867280 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:03.867337 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.867339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.868107 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.868108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.868906 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.868915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.869556 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.869557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.869642 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.869654 (+ 12us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.869746 (+ 92us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.869799 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1925,"thread_start_us":83,"threads_started":1}
I20260924 17:36:03.870507 20874 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a69cf6692db4671b12d5a507e5775e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:03 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:40030
I20260924 17:36:03.870951 20952 tablet_replica.cc:330] stopping tablet replica
I20260924 17:36:03.871068 20952 raft_consensus.cc:2229] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:03.871134 20952 raft_consensus.cc:2258] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:03.871410 20952 ts_tablet_manager.cc:1905] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:03.873385 20952 ts_tablet_manager.cc:1918] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:03.873473 20952 log.cc:1196] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/4a69cf6692db4671b12d5a507e5775e1
I20260924 17:36:03.873695 20952 ts_tablet_manager.cc:1939] T 4a69cf6692db4671b12d5a507e5775e1 P 27cc27676c1845acbf2115f6e32dd628: Deleting consensus metadata
I20260924 17:36:03.874156 20737 catalog_manager.cc:4841] TS 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951): tablet 4a69cf6692db4671b12d5a507e5775e1 (table test-table [id=5ddaba93b8a742dd868156732fe10b9a]) successfully deleted
W20260924 17:36:03.946282 20949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:03.946478 20949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:03.946502 20949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:03.947660 20949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:03.947700 20949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:03.947727 20949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:36:03.949165 20949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:40267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=41059
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:03.949409 20949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:03.949640 20949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:03.954542 20960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:03.954586 20958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.954833 20949 server_base.cc:1034] running on GCE node
W20260924 17:36:03.954610 20957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:03.955104 20949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:03.955343 20949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:03.956504 20949 hybrid_clock.cc:648] HybridClock initialized: now 1790271363956476 us; error 51 us; skew 500 ppm
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:03.958958 20949 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:36:03.959332 20949 webserver.cc:460] Webserver started at http://127.6.37.2:41059/ using document root <none> and password file <none>
I20260924 17:36:03.959519 20949 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:03.959570 20949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:03.960821 20949 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:03.961359 20967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.961520 20949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.961602 20949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "3c5348ae23494ef8aae81e1a140301af"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "29d1a8910a177a5865e7c0423576cd0b"
server_key_iv: "a9bd4b05cc1e64da8fe894cc5f060ecd"
server_key_version: "encryptionkey@0"
I20260924 17:36:03.961920 20949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:03.974035 20949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:03.976245 20949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:03.976389 20949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:03.976600 20949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:03.976886 20949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:03.976933 20949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.976974 20949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:03.977008 20949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:03.982681 20949 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:40267
I20260924 17:36:03.982769 21082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:40267 every 8 connection(s)
I20260924 17:36:03.983099 20949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:36:03.985852 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 20949
I20260924 17:36:03.986107 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:35417
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:45235
--webserver_port=41869
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:36:03 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271363, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:03.993562 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.983809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:41241)
0924 17:36:03.983980 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:03.984016 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:03.984452 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:03.984660 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:03.984663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:03.985184 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:03.985422 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.985428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.986192 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.986193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.987603 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:03.987607 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.988181 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.988182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:03.988287 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.988791 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:03.988798 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:03.990173 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:03.992192 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.992199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.992201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.992410 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.992632 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:03.992632 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:03.992632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:03.992730 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:03.993045 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:03.993050 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:03.993159 (+ 109us) client_negotiation.cc:769] Sending connection context
0924 17:36:03.993235 (+ 76us) client_negotiation.cc:240] Negotiation successful
0924 17:36:03.993407 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260924 17:36:03.993551 20946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:03.983803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41241 (local address 127.6.37.62:45235)
0924 17:36:03.983905 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:03.983908 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:03.984093 (+ 185us) server_negotiation.cc:407] Connection header received
0924 17:36:03.984545 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:03.984546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:03.984556 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:03.984603 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:03.985508 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.986099 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.987711 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:03.988090 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:03.988180 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:03.990271 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:03.990273 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:03.990273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:03.990284 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:03.992106 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.992487 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.992488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.992489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.992560 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:03.992797 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:03.992798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:03.992798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:03.992971 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:03.993050 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:03.993289 (+ 239us) server_negotiation.cc:299] Negotiation successful
0924 17:36:03.993401 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260924 17:36:03.994052 21083 heartbeater.cc:347] Connected to a master server at 127.6.37.62:45235
I20260924 17:36:03.994172 21083 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:03.994402 21083 heartbeater.cc:511] Master 127.6.37.62:45235 requested a full tablet report, sending...
I20260924 17:36:03.994846 20752 ts_manager.cc:194] Registered new tserver with Master: 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
I20260924 17:36:03.995247 20752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:41241
W20260924 17:36:04.070494 21086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:04.070688 21086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:04.070711 21086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:04.071911 21086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:04.071954 21086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:04.071981 21086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:36:04.073427 21086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:35417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=41869
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:04.073673 21086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:04.073918 21086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:04.079051 21094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.079080 21092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.079243 21091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:04.079216 21086 server_base.cc:1034] running on GCE node
I20260924 17:36:04.079460 21086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:04.079660 21086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:04.080832 21086 hybrid_clock.cc:648] HybridClock initialized: now 1790271364080805 us; error 31 us; skew 500 ppm
Sep 24 17:36:04 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:04.083173 21086 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:36:04.083614 21086 webserver.cc:460] Webserver started at http://127.6.37.3:41869/ using document root <none> and password file <none>
I20260924 17:36:04.083853 21086 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:04.083931 21086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:04.085285 21086 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.086036 21101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.086203 21086 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:04.086308 21086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "513cd54c397f472c862f8b855e639224"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "b584661f14dc1bedd241fbebd8724d3e"
server_key_iv: "34b529cbe981899330e658daa75b1bce"
server_key_version: "encryptionkey@0"
I20260924 17:36:04.086675 21086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:04.099182 21086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:04.101032 21086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:04.101197 21086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:04.101435 21086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:04.101750 21086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:04.101812 21086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.101858 21086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:04.101892 21086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.108237 21086 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:35417
I20260924 17:36:04.108299 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:35417 every 8 connection(s)
I20260924 17:36:04.108636 21086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:36:04.111567 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21086
Sep 24 17:36:04 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:04.118603 20946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.109324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:47297 (local address 127.6.37.62:45235)
0924 17:36:04.109382 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.109385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.109623 (+ 238us) server_negotiation.cc:407] Connection header received
0924 17:36:04.110069 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.110070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.110082 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.110141 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:04.111099 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.111587 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.112710 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.113009 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.113066 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.115190 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:04.115192 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:04.115192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:04.115200 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:04.117061 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:04.117419 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:04.117421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:04.117421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:04.117483 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:04.117831 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:04.117832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:04.117832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:04.118014 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:04.118082 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.118391 (+ 309us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.118492 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260924 17:36:04.118734 21221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.111966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58826 (local address 127.6.37.62:45235)
0924 17:36:04.112076 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.112078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.112090 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:36:04.112170 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.112171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.112183 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.112252 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:04.112886 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.113526 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.114365 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.114571 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.114657 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.115876 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:04.115877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:04.115878 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:04.115885 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:04.117507 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:04.117891 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:04.117892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:04.117892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:04.117942 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:04.118163 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:04.118164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:04.118164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:04.118250 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:04.118407 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.118444 (+ 37us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.118546 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":87,"thread_start_us":55,"threads_started":1}
I20260924 17:36:04.118789 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.109333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:47297)
0924 17:36:04.109486 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.109534 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:04.109981 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:04.110209 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:04.110212 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:04.110761 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:04.111016 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.111021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.111732 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.111733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.112621 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.112624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.113088 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.113089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.113228 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.113740 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:04.113748 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:04.115104 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:04.117144 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:04.117150 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:04.117151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:04.117350 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:04.117572 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:04.117573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:04.117573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:04.117701 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:04.118080 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:04.118091 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:04.118245 (+ 154us) client_negotiation.cc:769] Sending connection context
0924 17:36:04.118356 (+ 111us) client_negotiation.cc:240] Negotiation successful
0924 17:36:04.118536 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260924 17:36:04.119194 21217 heartbeater.cc:347] Connected to a master server at 127.6.37.62:45235
I20260924 17:36:04.119326 21217 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:04.119527 21217 heartbeater.cc:511] Master 127.6.37.62:45235 requested a full tablet report, sending...
I20260924 17:36:04.119874 20752 ts_manager.cc:194] Registered new tserver with Master: 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417)
I20260924 17:36:04.120184 20752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:47297
I20260924 17:36:04.130271 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:36:04.133028 21221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.130614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58834 (local address 127.6.37.62:45235)
0924 17:36:04.130672 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.130674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.130743 (+ 69us) server_negotiation.cc:407] Connection header received
0924 17:36:04.130830 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.130831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.130892 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.130983 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:36:04.131084 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.131542 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.132279 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.132479 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.132558 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.132721 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:36:04.132812 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:36:04.132903 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.132928 (+ 25us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.132950 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:36:04.133286 20752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:36:04.134922 20752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:36:04.136958 20874 tablet_service.cc:1467] Processing CreateTablet for tablet d12fe815fdf14d2795b7ae58bea90cf2 (DEFAULT_TABLE table=test-table [id=43ffa0bc8c104e69a64c50e9ed2de6bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:04.137161 20874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d12fe815fdf14d2795b7ae58bea90cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:04.138697 20832 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap starting.
I20260924 17:36:04.139057 20832 tablet_bootstrap.cc:654] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:04.139600 20832 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: No bootstrap required, opened a new log
I20260924 17:36:04.139669 20832 ts_tablet_manager.cc:1397] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.139789 20832 raft_consensus.cc:348] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.139861 20832 raft_consensus.cc:374] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:04.139931 20832 raft_consensus.cc:729] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27cc27676c1845acbf2115f6e32dd628, State: Initialized, Role: FOLLOWER
I20260924 17:36:04.139977 20832 consensus_queue.cc:260] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.140062 20832 ts_tablet_manager.cc:1428] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:04.140841 21224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.136829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56492 (local address 127.6.37.3:35417)
0924 17:36:04.136982 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.136987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.137140 (+ 153us) server_negotiation.cc:407] Connection header received
0924 17:36:04.137181 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.137183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.137199 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.137360 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:04.137458 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.138542 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.139751 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.140529 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.140596 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.140649 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.140735 (+ 86us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.140770 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260924 17:36:04.140827 20950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.136656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35417 (local address 127.0.0.1:56492)
0924 17:36:04.136977 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.136989 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:04.137059 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:04.137358 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:04.137359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:04.137361 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:04.137398 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.137399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.138631 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.138632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.139678 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.139680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.140595 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.140596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.140656 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.140660 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:04.140716 (+ 56us) client_negotiation.cc:240] Negotiation successful
0924 17:36:04.140761 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301}
I20260924 17:36:04.140913 21225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.136854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45892 (local address 127.6.37.2:40267)
0924 17:36:04.137046 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.137051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.137159 (+ 108us) server_negotiation.cc:407] Connection header received
0924 17:36:04.137230 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.137232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.137247 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.137317 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:04.137507 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.138174 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.139580 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.140478 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.140539 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.140599 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.140786 (+ 187us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.140828 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":83,"threads_started":1}
I20260924 17:36:04.140931 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.136748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40267 (local address 127.0.0.1:45892)
0924 17:36:04.137105 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.137114 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:04.137163 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:04.137398 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:04.137399 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:04.137401 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:04.137435 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.137436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.138281 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.138283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.139466 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.139469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.140631 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.140632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.140699 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.140702 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:36:04.140770 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 17:36:04.140813 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":102,"threads_started":1}
I20260924 17:36:04.141588 21016 tablet_service.cc:1467] Processing CreateTablet for tablet d12fe815fdf14d2795b7ae58bea90cf2 (DEFAULT_TABLE table=test-table [id=43ffa0bc8c104e69a64c50e9ed2de6bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:04.141583 21149 tablet_service.cc:1467] Processing CreateTablet for tablet d12fe815fdf14d2795b7ae58bea90cf2 (DEFAULT_TABLE table=test-table [id=43ffa0bc8c104e69a64c50e9ed2de6bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:04.142012 21016 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d12fe815fdf14d2795b7ae58bea90cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:04.142175 21149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d12fe815fdf14d2795b7ae58bea90cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:04.144989 21227 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Bootstrap starting.
I20260924 17:36:04.145299 21228 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Bootstrap starting.
I20260924 17:36:04.145709 21227 tablet_bootstrap.cc:654] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:04.146008 21228 tablet_bootstrap.cc:654] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:04.146245 21227 log.cc:824] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:04.146530 21228 log.cc:824] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:04.147105 21227 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: No bootstrap required, opened a new log
I20260924 17:36:04.147171 21227 ts_tablet_manager.cc:1397] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:04.147363 21228 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: No bootstrap required, opened a new log
I20260924 17:36:04.147439 21228 ts_tablet_manager.cc:1397] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:04.148638 21227 raft_consensus.cc:348] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.148813 21227 raft_consensus.cc:374] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:04.148711 21228 raft_consensus.cc:348] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.148869 21227 raft_consensus.cc:729] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c5348ae23494ef8aae81e1a140301af, State: Initialized, Role: FOLLOWER
I20260924 17:36:04.148871 21228 raft_consensus.cc:374] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:04.148914 21228 raft_consensus.cc:729] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 513cd54c397f472c862f8b855e639224, State: Initialized, Role: FOLLOWER
I20260924 17:36:04.149039 21228 consensus_queue.cc:260] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.149039 21227 consensus_queue.cc:260] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.149325 21228 ts_tablet_manager.cc:1428] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:04.149329 21217 heartbeater.cc:503] Master 127.6.37.62:45235 was elected leader, sending a full tablet report...
I20260924 17:36:04.149411 21227 ts_tablet_manager.cc:1428] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:04.149520 21083 heartbeater.cc:503] Master 127.6.37.62:45235 was elected leader, sending a full tablet report...
I20260924 17:36:04.221496 21232 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:04.221617 21232 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.221961 21232 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951)
I20260924 17:36:04.225458 21224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.222380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:42775 (local address 127.6.37.3:35417)
0924 17:36:04.222424 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.222426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.222435 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:36:04.222464 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.222465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.222477 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.222542 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:04.222708 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.223309 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.224448 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.225088 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.225153 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.225164 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.225319 (+ 155us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.225360 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:36:04.225478 21233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.222162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35417 (local address 127.6.37.2:42775)
0924 17:36:04.222336 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.222348 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:04.222396 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:04.222550 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:04.222551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:04.222553 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:04.222641 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.222642 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.223381 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.223382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.224370 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.224373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.225164 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.225165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.225219 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.225223 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:04.225304 (+ 81us) client_negotiation.cc:240] Negotiation successful
0924 17:36:04.225362 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":20,"thread_start_us":102,"threads_started":1}
I20260924 17:36:04.225903 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d12fe815fdf14d2795b7ae58bea90cf2" candidate_uuid: "3c5348ae23494ef8aae81e1a140301af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "513cd54c397f472c862f8b855e639224" is_pre_election: true
I20260924 17:36:04.225973 21085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.222147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:35951 (local address 127.6.37.2:39819)
0924 17:36:04.222210 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.222220 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:04.222278 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:04.222477 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:04.222479 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:04.222480 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:04.222562 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.222564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.223412 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.223413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.224276 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:04.224278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.225754 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.225755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:04.225852 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.225854 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:36:04.225896 (+ 42us) client_negotiation.cc:240] Negotiation successful
0924 17:36:04.225929 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260924 17:36:04.226034 20951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.222184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:39819 (local address 127.6.37.1:35951)
0924 17:36:04.222362 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.222365 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.222373 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:36:04.222404 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.222405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.222417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.222470 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:04.222636 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.223324 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.224375 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.225498 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.225567 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.225579 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.225922 (+ 343us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.225971 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260924 17:36:04.226078 21169 raft_consensus.cc:2454] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c5348ae23494ef8aae81e1a140301af in term 0.
I20260924 17:36:04.226357 20968 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c5348ae23494ef8aae81e1a140301af, 513cd54c397f472c862f8b855e639224; no voters:
I20260924 17:36:04.226502 21232 raft_consensus.cc:2781] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:36:04.226554 21232 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:36:04.226495 20895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d12fe815fdf14d2795b7ae58bea90cf2" candidate_uuid: "3c5348ae23494ef8aae81e1a140301af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27cc27676c1845acbf2115f6e32dd628" is_pre_election: true
I20260924 17:36:04.226577 21232 raft_consensus.cc:3037] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:04.226649 20895 raft_consensus.cc:2454] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c5348ae23494ef8aae81e1a140301af in term 0.
I20260924 17:36:04.227387 21232 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.227522 21232 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [CANDIDATE]: Term 1 election: Requested vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951)
I20260924 17:36:04.227671 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d12fe815fdf14d2795b7ae58bea90cf2" candidate_uuid: "3c5348ae23494ef8aae81e1a140301af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "513cd54c397f472c862f8b855e639224"
I20260924 17:36:04.227685 20895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d12fe815fdf14d2795b7ae58bea90cf2" candidate_uuid: "3c5348ae23494ef8aae81e1a140301af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27cc27676c1845acbf2115f6e32dd628"
I20260924 17:36:04.227753 20895 raft_consensus.cc:3037] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:04.227753 21169 raft_consensus.cc:3037] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:04.228622 21169 raft_consensus.cc:2454] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c5348ae23494ef8aae81e1a140301af in term 1.
I20260924 17:36:04.228622 20895 raft_consensus.cc:2454] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c5348ae23494ef8aae81e1a140301af in term 1.
I20260924 17:36:04.228888 20969 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628, 3c5348ae23494ef8aae81e1a140301af; no voters:
I20260924 17:36:04.228968 21232 raft_consensus.cc:2781] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:04.229081 21232 raft_consensus.cc:686] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 1 LEADER]: Becoming Leader. State: Replica: 3c5348ae23494ef8aae81e1a140301af, State: Running, Role: LEADER
I20260924 17:36:04.229184 21232 consensus_queue.cc:237] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.230113 20752 catalog_manager.cc:5495] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c5348ae23494ef8aae81e1a140301af (127.6.37.2). New cstate: current_term: 1 leader_uuid: "3c5348ae23494ef8aae81e1a140301af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } health_report { overall_health: UNKNOWN } } }
W20260924 17:36:04.233610 21084 tablet.cc:2369] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:36:04.256594 21225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.254177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45908 (local address 127.6.37.2:40267)
0924 17:36:04.254236 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:04.254238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:04.254247 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:36:04.254312 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:04.254313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:04.254340 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:04.254411 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:36:04.254546 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.255063 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.255800 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:04.256000 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:04.256072 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:04.256235 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:36:04.256344 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:36:04.256427 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:04.256468 (+ 41us) server_negotiation.cc:299] Negotiation successful
0924 17:36:04.256489 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260924 17:36:04.258385 21169 raft_consensus.cc:1261] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Refusing update from remote peer 3c5348ae23494ef8aae81e1a140301af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:04.258410 20895 raft_consensus.cc:1261] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Refusing update from remote peer 3c5348ae23494ef8aae81e1a140301af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:04.258735 21234 consensus_queue.cc:1035] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [LEADER]: Connected to new peer: Peer: permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:04.258889 21232 consensus_queue.cc:1035] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [LEADER]: Connected to new peer: Peer: permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:04.260886 21237 mvcc.cc:205] Tried to move back new op lower bound from 7332951507999444992 to 7332951507883614208. Current Snapshot: MvccSnapshot[applied={T|T < 7332951507999444992}]
I20260924 17:36:04.261274 21238 mvcc.cc:205] Tried to move back new op lower bound from 7332951507999444992 to 7332951507883614208. Current Snapshot: MvccSnapshot[applied={T|T < 7332951507999444992}]
I20260924 17:36:04.263381 20750 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:04.263484 20750 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:58834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:04.264182 20750 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Sending DeleteTablet for 3 replicas of tablet d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:04.264454 20874 tablet_service.cc:1514] Processing DeleteTablet for tablet d12fe815fdf14d2795b7ae58bea90cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:40030
I20260924 17:36:04.264559 20952 tablet_replica.cc:330] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: stopping tablet replica
I20260924 17:36:04.264547 21149 tablet_service.cc:1514] Processing DeleteTablet for tablet d12fe815fdf14d2795b7ae58bea90cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:56492
I20260924 17:36:04.264611 20952 raft_consensus.cc:2229] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:04.264663 20952 raft_consensus.cc:2258] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:04.264765 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20790
I20260924 17:36:04.264786 21246 tablet_replica.cc:330] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: stopping tablet replica
I20260924 17:36:04.264966 21246 raft_consensus.cc:2229] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:04.264982 20952 ts_tablet_manager.cc:1905] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:04.265130 21246 raft_consensus.cc:2258] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:04.265625 21246 ts_tablet_manager.cc:1905] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:04.267519 21246 ts_tablet_manager.cc:1918] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:04.267593 21246 log.cc:1196] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:04.267566 21016 tablet_service.cc:1514] Processing DeleteTablet for tablet d12fe815fdf14d2795b7ae58bea90cf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:04 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:45892
I20260924 17:36:04.267771 21247 tablet_replica.cc:330] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: stopping tablet replica
I20260924 17:36:04.267872 21246 ts_tablet_manager.cc:1939] T d12fe815fdf14d2795b7ae58bea90cf2 P 513cd54c397f472c862f8b855e639224: Deleting consensus metadata
I20260924 17:36:04.267869 21247 raft_consensus.cc:2229] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:36:04.267969 21247 raft_consensus.cc:2258] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:04.268252 20736 catalog_manager.cc:4841] TS 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): tablet d12fe815fdf14d2795b7ae58bea90cf2 (table test-table [id=43ffa0bc8c104e69a64c50e9ed2de6bb]) successfully deleted
I20260924 17:36:04.268456 21247 ts_tablet_manager.cc:1905] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:04.270458 21247 ts_tablet_manager.cc:1918] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:04.270537 21247 log.cc:1196] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:04.270805 21247 ts_tablet_manager.cc:1939] T d12fe815fdf14d2795b7ae58bea90cf2 P 3c5348ae23494ef8aae81e1a140301af: Deleting consensus metadata
I20260924 17:36:04.271355 20736 catalog_manager.cc:4841] TS 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): tablet d12fe815fdf14d2795b7ae58bea90cf2 (table test-table [id=43ffa0bc8c104e69a64c50e9ed2de6bb]) successfully deleted
W20260924 17:36:04.272583 20737 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:35951 (error 108)
I20260924 17:36:04.273102 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.272958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:35951 (local address 127.0.0.1:40032)
0924 17:36:04.273022 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.273067 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:35951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260924 17:36:04.273126 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20949
W20260924 17:36:04.274539 20737 catalog_manager.cc:4584] TS 27cc27676c1845acbf2115f6e32dd628 (127.6.37.1:35951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d12fe815fdf14d2795b7ae58bea90cf2: Network error: Client connection negotiation failed: client connection to 127.6.37.1:35951: connect: Connection refused (error 111)
I20260924 17:36:04.279439 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 21086
I20260924 17:36:04.284533 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 20719
I20260924 17:36:04.289925 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45235
--webserver_interface=127.6.37.62
--webserver_port=42111
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:45235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:04.372232 21249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:04.372417 21249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:04.372438 21249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:04.373579 21249 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:36:04.373623 21249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:04.373638 21249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:04.373685 21249 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:36:04.373710 21249 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:36:04.375187 21249 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:45235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=42111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:04.375428 21249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:04.375653 21249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:04.380383 21254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.380385 21257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.380374 21255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:04.380431 21249 server_base.cc:1034] running on GCE node
I20260924 17:36:04.380796 21249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:04.381104 21249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:04.382242 21249 hybrid_clock.cc:648] HybridClock initialized: now 1790271364382232 us; error 27 us; skew 500 ppm
Sep 24 17:36:04 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:04.384634 21249 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:36:04.384990 21249 webserver.cc:460] Webserver started at http://127.6.37.62:42111/ using document root <none> and password file <none>
I20260924 17:36:04.385178 21249 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:04.385219 21249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:04.386454 21249 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.387091 21264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.387279 21249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260924 17:36:04.387365 21249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "707bce8c9397451f82aa819f71402188"
format_stamp: "Formatted at 2026-09-24 17:36:02 on dist-test-slave-gcz9"
server_key: "06ff1e59787bd7013679645e2f298519"
server_key_iv: "4966d715480190795a52d4e0be88f3ed"
server_key_version: "encryptionkey@0"
I20260924 17:36:04.387694 21249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:04.395102 21249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:04.396921 21249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:04.397065 21249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:04.400877 21249 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:45235
I20260924 17:36:04.400906 21317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:45235 every 8 connection(s)
I20260924 17:36:04.401266 21249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:36:04.402761 21318 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:36:04.403424 21318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap starting.
I20260924 17:36:04.404750 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21249
I20260924 17:36:04.405018 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:35951
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:45235
--webserver_port=43889
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:36:04.411852 21318 log.cc:824] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:04.414004 21318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:36:04.414296 21318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188: Bootstrap complete.
I20260924 17:36:04.416601 21318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:04.416849 21318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 707bce8c9397451f82aa819f71402188, State: Initialized, Role: FOLLOWER
I20260924 17:36:04.417040 21318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:04.417133 21318 raft_consensus.cc:388] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:36:04.417186 21318 raft_consensus.cc:482] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:36:04.417236 21318 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 2 FOLLOWER]: Advancing to term 3
I20260924 17:36:04.418188 21318 raft_consensus.cc:504] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:04.418303 21318 leader_election.cc:302] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 707bce8c9397451f82aa819f71402188; no voters:
I20260924 17:36:04.418490 21318 leader_election.cc:288] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260924 17:36:04.418524 21322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 3 FOLLOWER]: Leader election won for term 3
I20260924 17:36:04.418628 21322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [term 3 LEADER]: Becoming Leader. State: Replica: 707bce8c9397451f82aa819f71402188, State: Running, Role: LEADER
I20260924 17:36:04.418725 21322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } }
I20260924 17:36:04.418761 21318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:36:04.419055 21322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 707bce8c9397451f82aa819f71402188. Latest consensus state: current_term: 3 leader_uuid: "707bce8c9397451f82aa819f71402188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } } }
I20260924 17:36:04.419139 21322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:04.419059 21323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "707bce8c9397451f82aa819f71402188" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "707bce8c9397451f82aa819f71402188" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45235 } } }
I20260924 17:36:04.419343 21327 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:36:04.419354 21323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 707bce8c9397451f82aa819f71402188 [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:04.420312 21327 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:36:04.420451 21327 catalog_manager.cc:1259] Loaded cluster ID: c9aef05591004fa2aa07b4597d8195fb
I20260924 17:36:04.420711 21327 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260924 17:36:04.420989 21327 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4f6db279ad google::LogMessage::Fail() at ??:0
@ 0x7f4f6db2a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f4f6db274de google::LogMessage::Flush() at ??:0
@ 0x7f4f6db28a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4f75a480f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f4f75a518b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4f6f9f50d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4f6f9ea954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4f7084e6db start_thread at ??:0
@ 0x7f4f6c62561f clone at ??:0
W20260924 17:36:04.503407 21320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:04.503607 21320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:04.503633 21320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:04.504864 21320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:04.504916 21320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:04.504945 21320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:36:04.506424 21320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:35951
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=43889
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:04.506726 21320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:04.507022 21320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:04.513046 21356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.513182 21355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.513059 21358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:04.513257 21320 server_base.cc:1034] running on GCE node
I20260924 17:36:04.513487 21320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:04.513747 21320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:04.514930 21320 hybrid_clock.cc:648] HybridClock initialized: now 1790271364514911 us; error 32 us; skew 500 ppm
Sep 24 17:36:04 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:04.517494 21320 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:36:04.517899 21320 webserver.cc:460] Webserver started at http://127.6.37.1:43889/ using document root <none> and password file <none>
I20260924 17:36:04.518126 21320 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:04.518189 21320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:04.519678 21320 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.520467 21365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.520634 21320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.520730 21320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "27cc27676c1845acbf2115f6e32dd628"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "bcda72fc6df8c4da446c23b58eff27ac"
server_key_iv: "53593214652658e1f16dbf56ca6cc1ab"
server_key_version: "encryptionkey@0"
I20260924 17:36:04.521077 21320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:04.528849 21320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:04.531081 21320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:04.531222 21320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:04.531428 21320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:04.531915 21372 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260924 17:36:04.534144 21320 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260924 17:36:04.534198 21320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260924 17:36:04.534255 21320 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260924 17:36:04.534855 21320 ts_tablet_manager.cc:610] Registered 1 tablets
I20260924 17:36:04.534946 21320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:04.535018 21372 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap starting.
I20260924 17:36:04.537045 21372 log.cc:824] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:04.540060 21372 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:36:04.540393 21372 tablet_bootstrap.cc:492] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Bootstrap complete.
I20260924 17:36:04.540555 21372 ts_tablet_manager.cc:1397] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260924 17:36:04.541982 21320 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:35951
I20260924 17:36:04.542083 21481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:35951 every 8 connection(s)
I20260924 17:36:04.542351 21320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:36:04.542595 21372 raft_consensus.cc:348] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.543363 21372 raft_consensus.cc:729] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27cc27676c1845acbf2115f6e32dd628, State: Initialized, Role: FOLLOWER
I20260924 17:36:04.543504 21372 consensus_queue.cc:260] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:04.543790 21372 ts_tablet_manager.cc:1428] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260924 17:36:04.550135 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21320
I20260924 17:36:04.550400 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:40267
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:45235
--webserver_port=41059
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:04.637307 21484 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:36:04.543086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:60977)
0924 17:36:04.543312 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.543932 (+ 620us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:04.544104 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:04.637072 (+ 92968us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":102,"threads_started":1}
W20260924 17:36:04.637575 21482 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:45235 (0 consecutive failures): Network error: Failed to ping master at 127.6.37.62:45235: Client connection negotiation failed: client connection to 127.6.37.62:45235: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260924 17:36:04.638150 21484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.637998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:55163)
0924 17:36:04.638063 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.638120 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260924 17:36:04.638535 21484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.638421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:39135)
0924 17:36:04.638472 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.638506 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260924 17:36:04.638664 21482 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:36:04.639530 21486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:04.639712 21486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:04.639763 21486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:04.640904 21486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:04.640949 21486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:04.641001 21486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:36:04.642436 21486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:40267
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=41059
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:04.642678 21486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:04.642943 21486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:04.647907 21492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.647918 21495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.647943 21493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:04.648070 21486 server_base.cc:1034] running on GCE node
I20260924 17:36:04.648324 21486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:04.648587 21486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:04.649761 21486 hybrid_clock.cc:648] HybridClock initialized: now 1790271364649748 us; error 29 us; skew 500 ppm
Sep 24 17:36:04 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:04.652485 21486 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:36:04.652972 21486 webserver.cc:460] Webserver started at http://127.6.37.2:41059/ using document root <none> and password file <none>
I20260924 17:36:04.653209 21486 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:04.653283 21486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:04.654661 21486 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.655336 21502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.655499 21486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.655601 21486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "3c5348ae23494ef8aae81e1a140301af"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "29d1a8910a177a5865e7c0423576cd0b"
server_key_iv: "a9bd4b05cc1e64da8fe894cc5f060ecd"
server_key_version: "encryptionkey@0"
I20260924 17:36:04.655949 21486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:04.679258 21486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:04.681665 21486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:04.681835 21486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:04.682081 21486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:04.682410 21486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:04.682464 21486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.682509 21486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:04.682542 21486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.689103 21486 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:40267
I20260924 17:36:04.689157 21616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:40267 every 8 connection(s)
I20260924 17:36:04.689512 21486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:36:04.690515 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.690102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:43529)
0924 17:36:04.690254 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.690350 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
W20260924 17:36:04.690897 21617 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:45235 (0 consecutive failures): Network error: Failed to ping master at 127.6.37.62:45235: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
I20260924 17:36:04.691205 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.691120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:46513)
0924 17:36:04.691162 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.691188 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260924 17:36:04.691454 21619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.691384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:60695)
0924 17:36:04.691419 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.691439 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260924 17:36:04.691571 21617 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 17:36:04.696306 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21486
I20260924 17:36:04.696497 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:35417
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:45235
--webserver_port=41869
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:04.777534 21620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:04.777742 21620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:04.777767 21620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:04.778856 21620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:04.778916 21620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:04.778942 21620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:36:04.780314 21620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:35417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=41869
--tserver_master_addrs=127.6.37.62:45235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:04.780509 21620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:04.780745 21620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:04.785758 21628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.785764 21626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:04.785746 21625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:04.786029 21620 server_base.cc:1034] running on GCE node
I20260924 17:36:04.786237 21620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:04.786468 21620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:04.787634 21620 hybrid_clock.cc:648] HybridClock initialized: now 1790271364787624 us; error 35 us; skew 500 ppm
Sep 24 17:36:04 dist-test-slave-gcz9 krb5kdc[20169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:04.790172 21620 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:36:04.790627 21620 webserver.cc:460] Webserver started at http://127.6.37.3:41869/ using document root <none> and password file <none>
I20260924 17:36:04.790863 21620 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:04.790987 21620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:04.792313 21620 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:04.792891 21635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.793056 21620 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:04.793150 21620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "513cd54c397f472c862f8b855e639224"
format_stamp: "Formatted at 2026-09-24 17:36:03 on dist-test-slave-gcz9"
server_key: "b584661f14dc1bedd241fbebd8724d3e"
server_key_iv: "34b529cbe981899330e658daa75b1bce"
server_key_version: "encryptionkey@0"
I20260924 17:36:04.793514 21620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:04.807937 21620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:04.810214 21620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:04.810369 21620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:04.810596 21620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:04.810989 21620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:04.811049 21620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.811091 21620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:04.811118 21620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:04.817497 21620 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:35417
I20260924 17:36:04.817584 21751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:35417 every 8 connection(s)
I20260924 17:36:04.818012 21620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:36:04.819274 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.818748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:44239)
0924 17:36:04.819006 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.819099 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
W20260924 17:36:04.819684 21752 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:45235 (0 consecutive failures): Network error: Failed to ping master at 127.6.37.62:45235: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
I20260924 17:36:04.820024 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.819902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:41285)
0924 17:36:04.819976 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.820000 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260924 17:36:04.820307 21754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:04.820219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:58997)
0924 17:36:04.820262 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:04.820284 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260924 17:36:04.820416 21752 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 17:36:04.821259 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21620
I20260924 17:36:05.639266 21756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:05.639036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:46331)
0924 17:36:05.639170 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:05.639205 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260924 17:36:05.692083 21757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:05.691863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:39541)
0924 17:36:05.691981 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:05.692015 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":63,"threads_started":1}
I20260924 17:36:05.820885 21758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:05.820697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:41047)
0924 17:36:05.820810 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:05.820840 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260924 17:36:06.316955 21759 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:06.317076 21759 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:06.317474 21759 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
Sep 24 17:36:06 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.3@KRBTEST.COM
Sep 24 17:36:06 dist-test-slave-gcz9 krb5kdc[20169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271364, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.2@KRBTEST.COM
I20260924 17:36:06.328509 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.317750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:34275 (local address 127.6.37.3:35417)
0924 17:36:06.317961 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:06.317975 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:06.318017 (+ 42us) server_negotiation.cc:407] Connection header received
0924 17:36:06.318631 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:06.318634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:06.318680 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:06.318810 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:06.319716 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.320687 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.321741 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.322181 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.322305 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:06.324743 (+ 2438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:06.324749 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:06.324749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:06.324762 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:06.326679 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327135 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:06.327138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:06.327138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:06.327217 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327470 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:06.327471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:06.327471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:06.327813 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:06.327904 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:06.328267 (+ 363us) server_negotiation.cc:299] Negotiation successful
0924 17:36:06.328394 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":65,"threads_started":1}
I20260924 17:36:06.328519 21763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.317914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:60651 (local address 127.6.37.2:40267)
0924 17:36:06.318039 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:06.318048 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:06.318067 (+ 19us) server_negotiation.cc:407] Connection header received
0924 17:36:06.318647 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:06.318650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:06.318690 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:06.318836 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:06.319978 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.321039 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.321785 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.322181 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.322313 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:06.325122 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:06.325126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:06.325126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:06.325135 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:06.327001 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327320 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:06.327323 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:06.327323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:06.327404 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327593 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:06.327594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:06.327594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:06.327867 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:06.327941 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:06.328259 (+ 318us) server_negotiation.cc:299] Negotiation successful
0924 17:36:06.328394 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":46,"threads_started":1}
I20260924 17:36:06.328545 21761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.317767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40267 (local address 127.6.37.1:60651)
0924 17:36:06.317915 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:06.317926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:06.317971 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:06.318888 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:06.318891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:06.319347 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:06.319860 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:06.319864 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.321154 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.321155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:06.321687 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:06.321689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.322292 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.322293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:06.322415 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:06.323056 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:06.323065 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:06.325011 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:06.327063 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327065 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:06.327065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:06.327232 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:06.327481 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327481 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:06.327481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:06.327537 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:06.327930 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:06.327930 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:06.328079 (+ 149us) client_negotiation.cc:769] Sending connection context
0924 17:36:06.328186 (+ 107us) client_negotiation.cc:240] Negotiation successful
0924 17:36:06.328400 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":27,"thread_start_us":47,"threads_started":1}
I20260924 17:36:06.328799 21760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.317611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35417 (local address 127.6.37.1:34275)
0924 17:36:06.317717 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:06.317728 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:06.317822 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:06.318894 (+ 1072us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:06.318895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:06.319355 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:06.319574 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:06.319580 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.320784 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.320785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:06.321654 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:06.321656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:06.322284 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:06.322285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:06.322415 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:06.323107 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:06.323112 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:06.324637 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:06.326772 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:06.326779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:06.326781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:06.327063 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:06.327289 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:06.327290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:06.327291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:06.327400 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:06.327887 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:06.327894 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:06.328079 (+ 185us) client_negotiation.cc:769] Sending connection context
0924 17:36:06.328186 (+ 107us) client_negotiation.cc:240] Negotiation successful
0924 17:36:06.328456 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":154,"thread_start_us":44,"threads_started":1}
W20260924 17:36:06.329408 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
W20260924 17:36:06.329934 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:06.330008 21366 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628; no voters: 3c5348ae23494ef8aae81e1a140301af, 513cd54c397f472c862f8b855e639224
I20260924 17:36:06.330144 21759 raft_consensus.cc:2726] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:36:06.639887 21760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.639698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:60771)
0924 17:36:06.639781 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:06.639815 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260924 17:36:06.692749 21764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.692522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:58547)
0924 17:36:06.692653 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:06.692702 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260924 17:36:06.821563 21765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:06.821363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:43459)
0924 17:36:06.821481 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:06.821516 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260924 17:36:07.640537 21766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:07.640328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:54781)
0924 17:36:07.640453 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:07.640487 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260924 17:36:07.693526 21767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:07.693269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:46043)
0924 17:36:07.693433 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:07.693478 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":104,"threads_started":1}
I20260924 17:36:07.822214 21768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:07.822015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:50443)
0924 17:36:07.822144 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:07.822179 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260924 17:36:07.922830 21769 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:07.922955 21769 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:07.923178 21769 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
W20260924 17:36:07.923640 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
W20260924 17:36:07.923708 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:07.923784 21366 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628; no voters: 3c5348ae23494ef8aae81e1a140301af, 513cd54c397f472c862f8b855e639224
I20260924 17:36:07.923918 21769 raft_consensus.cc:2726] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:36:08.641207 21770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:08.640995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:35863)
0924 17:36:08.641125 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:08.641159 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":59,"threads_started":1}
I20260924 17:36:08.694109 21771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:08.693907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:50705)
0924 17:36:08.694039 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:08.694071 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260924 17:36:08.823051 21772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:08.822739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:56781)
0924 17:36:08.822945 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:08.822990 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":59,"threads_started":1}
I20260924 17:36:09.641988 21773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:09.641734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:42153)
0924 17:36:09.641896 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:09.641937 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":65,"threads_started":1}
I20260924 17:36:09.682171 21774 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:09.682269 21774 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:09.682502 21774 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
W20260924 17:36:09.683027 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
W20260924 17:36:09.683125 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:09.683159 21366 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628; no voters: 3c5348ae23494ef8aae81e1a140301af, 513cd54c397f472c862f8b855e639224
I20260924 17:36:09.683264 21774 raft_consensus.cc:2726] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:36:09.695168 21775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:09.694583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:38645)
0924 17:36:09.695076 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:09.695118 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":61,"threads_started":1}
I20260924 17:36:09.823796 21776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:09.823565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:41775)
0924 17:36:09.823713 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:09.823752 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":58,"threads_started":1}
I20260924 17:36:10.642989 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:10.642654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:57441)
0924 17:36:10.642808 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:10.642855 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":68,"threads_started":1}
I20260924 17:36:10.695807 21778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:10.695599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:35955)
0924 17:36:10.695718 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:10.695752 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
I20260924 17:36:10.824661 21779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:10.824325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:34861)
0924 17:36:10.824531 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:10.824573 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260924 17:36:11.643692 21780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:11.643457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:55487)
0924 17:36:11.643600 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:11.643640 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260924 17:36:11.696434 21781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:11.696214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:56833)
0924 17:36:11.696357 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:11.696390 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260924 17:36:11.825292 21782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:11.825079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:36111)
0924 17:36:11.825214 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:11.825249 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":71,"threads_started":1}
I20260924 17:36:12.503511 21783 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:12.503607 21783 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:12.503767 21783 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
W20260924 17:36:12.504141 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
W20260924 17:36:12.504223 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:12.504240 21366 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628; no voters: 3c5348ae23494ef8aae81e1a140301af, 513cd54c397f472c862f8b855e639224
I20260924 17:36:12.504329 21783 raft_consensus.cc:2726] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:36:12.644506 21784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:12.644255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:58365)
0924 17:36:12.644412 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:12.644454 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260924 17:36:12.697147 21785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:12.696933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:41257)
0924 17:36:12.697071 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:12.697105 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260924 17:36:12.825989 21786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:12.825743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:59191)
0924 17:36:12.825892 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:12.825934 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":159,"threads_started":1}
I20260924 17:36:13.645259 21787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:13.645030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:59465)
0924 17:36:13.645166 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:13.645206 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260924 17:36:13.697781 21788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:13.697586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:45465)
0924 17:36:13.697708 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:13.697740 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
I20260924 17:36:13.826673 21789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:13.826444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:53351)
0924 17:36:13.826586 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:13.826629 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":62,"threads_started":1}
I20260924 17:36:14.646055 21790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:14.645809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:35555)
0924 17:36:14.645969 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:14.646007 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260924 17:36:14.698477 21791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:14.698218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:50561)
0924 17:36:14.698384 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:14.698430 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":60,"threads_started":1}
I20260924 17:36:14.827428 21792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:14.827201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:45803)
0924 17:36:14.827339 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:14.827381 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260924 17:36:15.646922 21793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:15.646606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:39965)
0924 17:36:15.646749 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:15.646807 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260924 17:36:15.699209 21794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:15.699007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:54501)
0924 17:36:15.699120 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:15.699153 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":69,"threads_started":1}
I20260924 17:36:15.828142 21795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:15.827928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:45175)
0924 17:36:15.828057 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:15.828094 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260924 17:36:16.647634 21796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:16.647392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:49857)
0924 17:36:16.647550 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:16.647586 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":77,"threads_started":1}
I20260924 17:36:16.650035 21797 raft_consensus.cc:482] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:16.650111 21797 raft_consensus.cc:504] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "513cd54c397f472c862f8b855e639224" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35417 } } peers { permanent_uuid: "3c5348ae23494ef8aae81e1a140301af" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40267 } } peers { permanent_uuid: "27cc27676c1845acbf2115f6e32dd628" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 35951 } }
I20260924 17:36:16.650297 21797 leader_election.cc:288] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417), 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267)
W20260924 17:36:16.650696 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 513cd54c397f472c862f8b855e639224 (127.6.37.3:35417): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
W20260924 17:36:16.650775 21366 leader_election.cc:341] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3c5348ae23494ef8aae81e1a140301af (127.6.37.2:40267): Not found: Tablet not found: d12fe815fdf14d2795b7ae58bea90cf2
I20260924 17:36:16.650808 21366 leader_election.cc:302] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27cc27676c1845acbf2115f6e32dd628; no voters: 3c5348ae23494ef8aae81e1a140301af, 513cd54c397f472c862f8b855e639224
I20260924 17:36:16.650919 21797 raft_consensus.cc:2726] T d12fe815fdf14d2795b7ae58bea90cf2 P 27cc27676c1845acbf2115f6e32dd628 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:36:16.699872 21798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:16.699652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:47511)
0924 17:36:16.699789 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:16.699825 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260924 17:36:16.828824 21799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:16.828606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:40417)
0924 17:36:16.828736 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:16.828779 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":98,"threads_started":1}
I20260924 17:36:17.648353 21800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:17.648106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:56059)
0924 17:36:17.648259 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:17.648303 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":94,"threads_started":1}
I20260924 17:36:17.700534 21801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:17.700311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:52471)
0924 17:36:17.700444 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:17.700486 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":58,"threads_started":1}
I20260924 17:36:17.829463 21802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:17.829252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:59093)
0924 17:36:17.829381 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:17.829417 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260924 17:36:18.649070 21803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:18.648812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:41245)
0924 17:36:18.648971 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:18.649017 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
I20260924 17:36:18.701208 21804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:18.700966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:58773)
0924 17:36:18.701130 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:18.701165 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":93,"threads_started":1}
I20260924 17:36:18.830220 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:18.829973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:48959)
0924 17:36:18.830108 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:18.830172 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":59,"threads_started":1}
I20260924 17:36:19.649935 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:19.649716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.1:52987)
0924 17:36:19.649855 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:19.649889 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":75,"threads_started":1}
I20260924 17:36:19.701928 21807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:19.701703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.2:55265)
0924 17:36:19.701826 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:19.701868 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":69,"threads_started":1}
I20260924 17:36:19.831017 21808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:19.830744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45235 (local address 127.6.37.3:37967)
0924 17:36:19.830929 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:19.830968 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:45235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":59,"threads_started":1}
I20260924 17:36:19.831640 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 21320
I20260924 17:36:19.836817 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 21486
I20260924 17:36:19.841593 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 21620
2026-09-24T17:36:19Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18131 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:36:19 dist-test-slave-gcz9 krb5kdc[21811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:36:19 dist-test-slave-gcz9 krb5kdc[21811](info): set up 2 sockets
Sep 24 17:36:19 dist-test-slave-gcz9 krb5kdc[21811](info): commencing operation
krb5kdc: starting...
W20260924 17:36:20.892693 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:36:20 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:36:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:36:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:36:21.013540 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38297
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:38297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:21.094833 21825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:21.095378 21825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:21.095463 21825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:21.097172 21825 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260924 17:36:21.097262 21825 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260924 17:36:21.097312 21825 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260924 17:36:21.097342 21825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:36:21.097396 21825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:21.097466 21825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:21.097543 21825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:36:21.097606 21825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:36:21.100049 21825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:38297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:21.100459 21825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:21.100847 21825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:21.108723 21830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:21.108933 21833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:21.108738 21831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:21.109548 21825 server_base.cc:1034] running on GCE node
I20260924 17:36:21.109931 21825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:21.110486 21825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:21.111713 21825 hybrid_clock.cc:648] HybridClock initialized: now 1790271381111680 us; error 45 us; skew 500 ppm
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:21.116007 21825 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:36:21.116832 21825 webserver.cc:460] Webserver started at http://127.6.37.62:39161/ using document root <none> and password file <none>
I20260924 17:36:21.117211 21825 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:21.117321 21825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:21.117559 21825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:21.119501 21825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "505ac02d757f4338a14beb624d336d0e"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "f589ff46d36c4087cfe377d1290633e5"
server_key_iv: "afa4e55182ea9650dae09e594864da54"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.120117 21825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "505ac02d757f4338a14beb624d336d0e"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "f589ff46d36c4087cfe377d1290633e5"
server_key_iv: "afa4e55182ea9650dae09e594864da54"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.122608 21825 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260924 17:36:21.123879 21840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.124100 21825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:21.124251 21825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "505ac02d757f4338a14beb624d336d0e"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "f589ff46d36c4087cfe377d1290633e5"
server_key_iv: "afa4e55182ea9650dae09e594864da54"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.124375 21825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:21.138458 21825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:21.142748 21825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:21.143105 21825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:21.151669 21825 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:38297
I20260924 17:36:21.151721 21892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:38297 every 8 connection(s)
I20260924 17:36:21.152325 21825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:36:21.153867 21893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:21.158669 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21825
I20260924 17:36:21.158784 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:36:21.158967 21893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap starting.
I20260924 17:36:21.159170 6292 external_mini_cluster.cc:1428] Setting key dfa3d56cf9466aade5c95dfb032c19cf
I20260924 17:36:21.160177 21893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:21.160780 21893 log.cc:824] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:21.161921 21893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: No bootstrap required, opened a new log
I20260924 17:36:21.165282 21893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:21.165539 21893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:21.165658 21893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505ac02d757f4338a14beb624d336d0e, State: Initialized, Role: FOLLOWER
I20260924 17:36:21.165891 21893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:21.166040 21893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:36:21.166146 21893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:36:21.166241 21893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:21.167296 21893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:21.167516 21893 leader_election.cc:302] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 505ac02d757f4338a14beb624d336d0e; no voters:
I20260924 17:36:21.167992 21893 leader_election.cc:288] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:36:21.168017 21899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:21.168527 21899 raft_consensus.cc:686] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 LEADER]: Becoming Leader. State: Replica: 505ac02d757f4338a14beb624d336d0e, State: Running, Role: LEADER
I20260924 17:36:21.168901 21899 consensus_queue.cc:237] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:21.168917 21893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:36:21.171053 21901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 505ac02d757f4338a14beb624d336d0e. Latest consensus state: current_term: 1 leader_uuid: "505ac02d757f4338a14beb624d336d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } } }
I20260924 17:36:21.171213 21901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: This master's current role is: LEADER
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:21.171849 21900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "505ac02d757f4338a14beb624d336d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } } }
I20260924 17:36:21.171955 21900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:21.172420 21911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:36:21.173676 21911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:36:21.178345 21911 catalog_manager.cc:1347] Generated new cluster ID: 8bb6c9b8488f4304be37ff8f7a72e932
I20260924 17:36:21.178458 21911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:36:21.181203 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.160019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32828 (local address 127.6.37.62:38297)
0924 17:36:21.160332 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.160354 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.160424 (+ 70us) server_negotiation.cc:407] Connection header received
0924 17:36:21.161280 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.161290 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.161367 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.161621 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:21.162930 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.164395 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.165662 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.166644 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.166989 (+ 345us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.172683 (+ 5694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:21.172690 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:21.172690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:21.172719 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:21.178065 (+ 5346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.178844 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.178848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.178848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.179039 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.179471 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.179472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.179472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.180026 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:21.180266 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.180522 (+ 256us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.180837 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":123,"threads_started":1}
I20260924 17:36:21.201548 21911 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:36:21.202346 21911 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:36:21.209389 21911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Generated new TSK 0
I20260924 17:36:21.209777 21911 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:36:21.255362 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38297
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:21.439845 21922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:21.440263 21922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:21.440344 21922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:21.442384 21922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:21.442487 21922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:21.442592 21922 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:36:21.445335 21922 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:21.445825 21922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:21.446310 21922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:21.455520 21930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:21.455910 21927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:21.455549 21928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:21.456238 21922 server_base.cc:1034] running on GCE node
I20260924 17:36:21.456997 21922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:21.457544 21922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:21.458778 21922 hybrid_clock.cc:648] HybridClock initialized: now 1790271381458745 us; error 44 us; skew 500 ppm
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:21.464371 21922 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:36:21.465878 21922 webserver.cc:460] Webserver started at http://127.6.37.1:38931/ using document root <none> and password file <none>
I20260924 17:36:21.466392 21922 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:21.466574 21922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:21.467252 21922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:21.470799 21922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "14857379c67a4653b578843f794f98d1"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "0da19a2adde67fbf9d8d3e01e17f8d83"
server_key_iv: "1f915629ae1c8cdfa5c61b290ac8b41e"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.471897 21922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "14857379c67a4653b578843f794f98d1"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "0da19a2adde67fbf9d8d3e01e17f8d83"
server_key_iv: "1f915629ae1c8cdfa5c61b290ac8b41e"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.474996 21922 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260924 17:36:21.476936 21937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.477612 21922 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:36:21.477810 21922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "14857379c67a4653b578843f794f98d1"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "0da19a2adde67fbf9d8d3e01e17f8d83"
server_key_iv: "1f915629ae1c8cdfa5c61b290ac8b41e"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.478027 21922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:21.495551 21922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:21.499838 21922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:21.500404 21922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:21.501106 21922 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:21.502141 21922 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:21.502228 21922 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.502353 21922 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:21.502457 21922 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.515838 21922 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:38217
I20260924 17:36:21.515909 22051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:38217 every 8 connection(s)
I20260924 17:36:21.516695 21922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:36:21.525756 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 21922
I20260924 17:36:21.526069 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:36:21.526484 6292 external_mini_cluster.cc:1428] Setting key 278bb000f7cc5595b7a7142bcb55a7a9
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:21.539688 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.517837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:43717 (local address 127.6.37.62:38297)
0924 17:36:21.517946 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.517950 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.518358 (+ 408us) server_negotiation.cc:407] Connection header received
0924 17:36:21.519207 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.519209 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.519220 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.519378 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:21.520931 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.521960 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.524401 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.524766 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.524886 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.530748 (+ 5862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:21.530750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:21.530750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:21.530767 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:21.535166 (+ 4399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.536046 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.536048 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.536048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.536186 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.537252 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.537254 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.537255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.537544 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:21.537750 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.539214 (+ 1464us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.539472 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260924 17:36:21.539705 22054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.517904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:43717)
0924 17:36:21.518148 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:21.518218 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:21.519018 (+ 800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:21.519473 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:21.519484 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:21.520426 (+ 942us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:21.520778 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.520790 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.522368 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.522369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.524276 (+ 1907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.524278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.524913 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.524914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.525107 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.526118 (+ 1011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:21.526136 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:21.530450 (+ 4314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:21.535309 (+ 4859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:21.535326 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:21.535329 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:21.535760 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:21.536447 (+ 687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:21.536448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:21.536449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:21.537000 (+ 551us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:21.537745 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:21.537795 (+ 50us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:21.538575 (+ 780us) client_negotiation.cc:769] Sending connection context
0924 17:36:21.539075 (+ 500us) client_negotiation.cc:240] Negotiation successful
0924 17:36:21.539430 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":147,"threads_started":1}
I20260924 17:36:21.540578 22052 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38297
I20260924 17:36:21.540736 22052 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:21.541060 22052 heartbeater.cc:511] Master 127.6.37.62:38297 requested a full tablet report, sending...
I20260924 17:36:21.541863 21857 ts_manager.cc:194] Registered new tserver with Master: 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217)
I20260924 17:36:21.543022 21857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:43717
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:36:21.574788 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38297
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:21.726460 22057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:21.726810 22057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:21.726850 22057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:21.728749 22057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:21.728816 22057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:21.728906 22057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:36:21.731880 22057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:21.732324 22057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:21.732710 22057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:21.740427 22062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:21.740427 22065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:21.740648 22057 server_base.cc:1034] running on GCE node
W20260924 17:36:21.740887 22063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:21.741302 22057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:21.741581 22057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:21.742797 22057 hybrid_clock.cc:648] HybridClock initialized: now 1790271381742761 us; error 66 us; skew 500 ppm
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:21.747509 22057 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:36:21.748183 22057 webserver.cc:460] Webserver started at http://127.6.37.2:43051/ using document root <none> and password file <none>
I20260924 17:36:21.748555 22057 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:21.748641 22057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:21.748864 22057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:21.749936 22057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "a3b605cb098744c486cc667cabc33967"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "4aca59d693e4e7ce12aa26569b427dd6"
server_key_iv: "a4181b4b4c61bf014a4feb9ec92c4f2c"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.750295 22057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "a3b605cb098744c486cc667cabc33967"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "4aca59d693e4e7ce12aa26569b427dd6"
server_key_iv: "a4181b4b4c61bf014a4feb9ec92c4f2c"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.752002 22057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260924 17:36:21.752951 22072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.753194 22057 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:21.753309 22057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "a3b605cb098744c486cc667cabc33967"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "4aca59d693e4e7ce12aa26569b427dd6"
server_key_iv: "a4181b4b4c61bf014a4feb9ec92c4f2c"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.753394 22057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:21.766976 22057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:21.769169 22057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:21.769323 22057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:21.769569 22057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:21.769919 22057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:21.769956 22057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.769979 22057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:21.770027 22057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.775750 22057 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:42619
I20260924 17:36:21.775868 22186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:42619 every 8 connection(s)
I20260924 17:36:21.776156 22057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:21.785555 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22057
I20260924 17:36:21.785651 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:36:21.785892 6292 external_mini_cluster.cc:1428] Setting key 60e073fcb9cecde438800c7cb16857fc
I20260924 17:36:21.785997 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.776965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:49951 (local address 127.6.37.62:38297)
0924 17:36:21.777027 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.777030 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.777234 (+ 204us) server_negotiation.cc:407] Connection header received
0924 17:36:21.777785 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.777787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.777799 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.777857 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:21.778831 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.779394 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.780423 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.780639 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.780724 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.782841 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:21.782843 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:21.782843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:21.782851 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:21.784522 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.784878 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.784879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.784879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.784940 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.785169 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.785169 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.785170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.785297 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:21.785398 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.785802 (+ 404us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.785896 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:36:21.786159 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.776943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:49951)
0924 17:36:21.777107 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:21.777151 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:21.777676 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:21.777935 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:21.777939 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:21.778519 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:21.778714 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.778720 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.779512 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.779513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.780320 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.780323 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.780737 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.780738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.780870 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.781365 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:21.781374 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:21.782745 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:21.784591 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:21.784597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:21.784599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:21.784804 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:21.785015 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:21.785016 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:21.785016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:21.785111 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:21.785397 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:21.785403 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:21.785599 (+ 196us) client_negotiation.cc:769] Sending connection context
0924 17:36:21.785762 (+ 163us) client_negotiation.cc:240] Negotiation successful
0924 17:36:21.785899 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260924 17:36:21.786675 22187 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38297
I20260924 17:36:21.786800 22187 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:21.787031 22187 heartbeater.cc:511] Master 127.6.37.62:38297 requested a full tablet report, sending...
I20260924 17:36:21.787499 21856 ts_manager.cc:194] Registered new tserver with Master: a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
I20260924 17:36:21.787896 21856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:49951
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:36:21.812137 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38297
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:21.892693 22192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:21.892920 22192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:21.892957 22192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:21.894078 22192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:21.894141 22192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:21.894187 22192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:36:21.896096 22192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:21.896370 22192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:21.896611 22192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:21.901515 22200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:21.901700 22192 server_base.cc:1034] running on GCE node
W20260924 17:36:21.901590 22198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:21.901587 22197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:21.902021 22192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:21.902299 22192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:21.903487 22192 hybrid_clock.cc:648] HybridClock initialized: now 1790271381903469 us; error 30 us; skew 500 ppm
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:21.905979 22192 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:36:21.906414 22192 webserver.cc:460] Webserver started at http://127.6.37.3:46853/ using document root <none> and password file <none>
I20260924 17:36:21.906642 22192 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:21.906713 22192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:21.906906 22192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:36:21.907913 22192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "b685887d83395c7a13a4d3a739bac25a"
server_key_iv: "66f0d570e9a2768c93a74002692b7a72"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.908264 22192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "b685887d83395c7a13a4d3a739bac25a"
server_key_iv: "66f0d570e9a2768c93a74002692b7a72"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.909555 22192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:36:21.910274 22207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.910444 22192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:21.910543 22192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "b685887d83395c7a13a4d3a739bac25a"
server_key_iv: "66f0d570e9a2768c93a74002692b7a72"
server_key_version: "encryptionkey@0"
I20260924 17:36:21.910629 22192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:21.918725 22192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:21.920480 22192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:21.920634 22192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:21.920843 22192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:21.921151 22192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:21.921213 22192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.921254 22192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:21.921283 22192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:21.927109 22192 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38953
I20260924 17:36:21.927198 22322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38953 every 8 connection(s)
I20260924 17:36:21.927490 22192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:36:21 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271381, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:21.936862 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.928194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:34509 (local address 127.6.37.62:38297)
0924 17:36:21.928239 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.928241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.928446 (+ 205us) server_negotiation.cc:407] Connection header received
0924 17:36:21.928980 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.928981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.929006 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.929082 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:21.930129 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.930631 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.931733 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.931931 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.932046 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.934142 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:21.934144 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:21.934144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:21.934151 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:21.935457 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.935870 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.935871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.935871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.935935 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.936194 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.936195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.936195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.936313 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:21.936391 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.936669 (+ 278us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.936750 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:36:21.936968 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22192
I20260924 17:36:21.937060 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:36:21.937052 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.928166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:34509)
0924 17:36:21.928334 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:21.928368 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:21.928864 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:21.929160 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:21.929164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:21.929831 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:21.930022 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.930027 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.930728 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.930729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.931635 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.931638 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.932062 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.932063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.932199 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.932723 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:21.932732 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:21.934043 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:21.935561 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:21.935569 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:21.935571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:21.935792 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:21.936009 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:21.936010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:21.936011 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:21.936125 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:21.936383 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:21.936389 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:21.936537 (+ 148us) client_negotiation.cc:769] Sending connection context
0924 17:36:21.936647 (+ 110us) client_negotiation.cc:240] Negotiation successful
0924 17:36:21.936807 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260924 17:36:21.937285 6292 external_mini_cluster.cc:1428] Setting key 9cafa257a9137650398ef98d1390e870
I20260924 17:36:21.937666 22324 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38297
I20260924 17:36:21.937788 22324 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:21.937987 22324 heartbeater.cc:511] Master 127.6.37.62:38297 requested a full tablet report, sending...
I20260924 17:36:21.938337 21856 ts_manager.cc:194] Registered new tserver with Master: 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953)
I20260924 17:36:21.938721 21856 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:34509
I20260924 17:36:21.949162 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:36:21.956604 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.950557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32834 (local address 127.6.37.62:38297)
0924 17:36:21.950615 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.950618 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.950768 (+ 150us) server_negotiation.cc:407] Connection header received
0924 17:36:21.950806 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.950806 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.950815 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.950860 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:21.951456 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.951916 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.952635 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.952807 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.952855 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.954041 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:21.954042 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:21.954042 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:21.954047 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:21.955404 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.955818 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.955819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.955819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.955866 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:21.956064 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:21.956064 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:21.956064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:21.956268 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:21.956342 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.956457 (+ 115us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.956517 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260924 17:36:21.958544 21856 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:36:21.960255 21856 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:36:21.966830 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.963039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49822 (local address 127.6.37.1:38217)
0924 17:36:21.963230 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.963234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.963243 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:36:21.963275 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.963277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.963290 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.963358 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:21.963584 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.964435 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.965698 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.966417 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.966474 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.966535 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.966704 (+ 169us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.966744 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
I20260924 17:36:21.966815 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.962751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:38217 (local address 127.0.0.1:49822)
0924 17:36:21.963152 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:21.963160 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:21.963198 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:21.963400 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:21.963403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:21.963405 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:21.963476 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.963478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.964549 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.964550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.965604 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.965606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.966482 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.966482 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.966572 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.966595 (+ 23us) client_negotiation.cc:769] Sending connection context
0924 17:36:21.966684 (+ 89us) client_negotiation.cc:240] Negotiation successful
0924 17:36:21.966740 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":2,"thread_start_us":83,"threads_started":1}
I20260924 17:36:21.967208 22335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.962745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:42619 (local address 127.0.0.1:42716)
0924 17:36:21.962942 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:21.962985 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:21.963051 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:21.963719 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:21.963720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:21.963722 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:21.963772 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.963773 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.965091 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.965092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.966040 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.966043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.966944 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.966945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.967012 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.967015 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:36:21.967075 (+ 60us) client_negotiation.cc:240] Negotiation successful
0924 17:36:21.967116 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":52,"threads_started":1}
I20260924 17:36:21.967239 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.962904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42716 (local address 127.6.37.2:42619)
0924 17:36:21.963491 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.963496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.963506 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:36:21.963545 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.963547 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.963564 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.963641 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:21.963854 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.964958 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.966129 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.966764 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.966832 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.966907 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.967110 (+ 203us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.967156 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":86,"threads_started":1}
I20260924 17:36:21.967442 22336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.962751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38953 (local address 127.0.0.1:55706)
0924 17:36:21.963008 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:21.963020 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:21.963074 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:21.963878 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:21.963879 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:21.963881 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:21.963921 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.963922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.965212 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.965213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.966310 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:21.966312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.967234 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.967235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:21.967296 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.967300 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:21.967331 (+ 31us) client_negotiation.cc:240] Negotiation successful
0924 17:36:21.967370 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":81,"threads_started":1}
I20260924 17:36:21.967772 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:21.963246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55706 (local address 127.6.37.3:38953)
0924 17:36:21.963638 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:21.963642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:21.963652 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:36:21.963688 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:21.963690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:21.963783 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:21.963988 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:21.964059 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.965104 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.966401 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:21.967144 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:21.967549 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:21.967619 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:21.967646 (+ 27us) server_negotiation.cc:299] Negotiation successful
0924 17:36:21.967690 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":109,"threads_started":1}
I20260924 17:36:21.967993 21985 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 (DEFAULT_TABLE table=test-table [id=92e97ef2031e483ca4a852220c7f7c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:21.968150 22120 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 (DEFAULT_TABLE table=test-table [id=92e97ef2031e483ca4a852220c7f7c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:21.968370 21985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbbd28b74324e5e91b94c32195c3b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:21.968343 22256 tablet_service.cc:1467] Processing CreateTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 (DEFAULT_TABLE table=test-table [id=92e97ef2031e483ca4a852220c7f7c88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:21.968546 22120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbbd28b74324e5e91b94c32195c3b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:21.968654 22256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2bbbd28b74324e5e91b94c32195c3b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:21.971586 22341 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Bootstrap starting.
I20260924 17:36:21.971783 22343 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Bootstrap starting.
I20260924 17:36:21.972476 22341 tablet_bootstrap.cc:654] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:21.972476 22343 tablet_bootstrap.cc:654] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:21.973112 22341 log.cc:824] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:21.973112 22343 log.cc:824] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:21.973464 22342 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Bootstrap starting.
I20260924 17:36:21.973913 22343 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: No bootstrap required, opened a new log
I20260924 17:36:21.974012 22343 ts_tablet_manager.cc:1397] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:21.974140 22342 tablet_bootstrap.cc:654] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:21.974385 22341 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: No bootstrap required, opened a new log
I20260924 17:36:21.974460 22341 ts_tablet_manager.cc:1397] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:36:21.974730 22342 log.cc:824] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:21.975484 22342 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: No bootstrap required, opened a new log
I20260924 17:36:21.975549 22342 ts_tablet_manager.cc:1397] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:36:21.975773 22343 raft_consensus.cc:348] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:21.975956 22343 raft_consensus.cc:374] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:21.976016 22343 raft_consensus.cc:729] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9f7e249edb4f8f9740d1f6a28b50ab, State: Initialized, Role: FOLLOWER
I20260924 17:36:21.976147 22343 consensus_queue.cc:260] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:21.976400 22343 ts_tablet_manager.cc:1428] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 17:36:21.976547 22324 heartbeater.cc:503] Master 127.6.37.62:38297 was elected leader, sending a full tablet report...
I20260924 17:36:21.976500 22341 raft_consensus.cc:348] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:21.976668 22341 raft_consensus.cc:374] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:21.976711 22341 raft_consensus.cc:729] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3b605cb098744c486cc667cabc33967, State: Initialized, Role: FOLLOWER
I20260924 17:36:21.976859 22341 consensus_queue.cc:260] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:21.977631 22341 ts_tablet_manager.cc:1428] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:36:21.977532 22342 raft_consensus.cc:348] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:21.977679 22342 raft_consensus.cc:374] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:21.977720 22342 raft_consensus.cc:729] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14857379c67a4653b578843f794f98d1, State: Initialized, Role: FOLLOWER
I20260924 17:36:21.977764 22187 heartbeater.cc:503] Master 127.6.37.62:38297 was elected leader, sending a full tablet report...
I20260924 17:36:21.977841 22342 consensus_queue.cc:260] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:21.978101 22342 ts_tablet_manager.cc:1428] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:36:21.978189 22052 heartbeater.cc:503] Master 127.6.37.62:38297 was elected leader, sending a full tablet report...
I20260924 17:36:22.003125 22348 raft_consensus.cc:482] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:22.003233 22348 raft_consensus.cc:504] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:22.003552 22348 leader_election.cc:288] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217), 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953)
I20260924 17:36:22.007506 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:22.003792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:47251 (local address 127.6.37.3:38953)
0924 17:36:22.003840 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:22.003842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:22.003854 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:36:22.003892 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:22.003893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:22.003908 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:22.003994 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:22.004170 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.004962 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.006522 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.007125 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.007201 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:22.007211 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:22.007400 (+ 189us) server_negotiation.cc:299] Negotiation successful
0924 17:36:22.007437 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:36:22.007508 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:22.003791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:38581 (local address 127.6.37.1:38217)
0924 17:36:22.003848 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:22.003849 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:22.003976 (+ 127us) server_negotiation.cc:407] Connection header received
0924 17:36:22.004007 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:22.004008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:22.004019 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:22.004075 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:22.004221 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.004962 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.006529 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.007125 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.007201 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:22.007211 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:22.007400 (+ 189us) server_negotiation.cc:299] Negotiation successful
0924 17:36:22.007437 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 17:36:22.007519 22189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:22.003716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38953 (local address 127.6.37.2:47251)
0924 17:36:22.003774 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:22.003786 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:22.003839 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:22.004004 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:22.004005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:22.004006 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:22.004094 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:22.004095 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.005061 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.005063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:22.006395 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:22.006399 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.007215 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.007216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:22.007305 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:22.007307 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:36:22.007370 (+ 63us) client_negotiation.cc:240] Negotiation successful
0924 17:36:22.007424 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":43}
I20260924 17:36:22.007526 22350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:22.003716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:38217 (local address 127.6.37.2:38581)
0924 17:36:22.003905 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:22.003913 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:22.003962 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:22.004087 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:22.004088 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:22.004089 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:22.004149 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:22.004150 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.005061 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.005063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:22.006408 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:22.006410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.007215 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.007216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:22.007302 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:22.007307 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:36:22.007379 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:36:22.007424 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":101,"thread_start_us":105,"threads_started":1}
I20260924 17:36:22.007885 22276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbbd28b74324e5e91b94c32195c3b28" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" is_pre_election: true
I20260924 17:36:22.008051 22276 raft_consensus.cc:2454] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 0.
I20260924 17:36:22.008112 22005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbbd28b74324e5e91b94c32195c3b28" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14857379c67a4653b578843f794f98d1" is_pre_election: true
I20260924 17:36:22.008273 22076 leader_election.cc:302] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967; no voters:
I20260924 17:36:22.008296 22005 raft_consensus.cc:2454] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 0.
I20260924 17:36:22.008392 22348 raft_consensus.cc:2781] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:36:22.008466 22348 raft_consensus.cc:482] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:36:22.008492 22348 raft_consensus.cc:3037] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:22.009198 22348 raft_consensus.cc:504] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:22.009342 22348 leader_election.cc:288] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 election: Requested vote from peers 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217), 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953)
I20260924 17:36:22.009509 22005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbbd28b74324e5e91b94c32195c3b28" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14857379c67a4653b578843f794f98d1"
I20260924 17:36:22.009588 22005 raft_consensus.cc:3037] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:22.009552 22276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2bbbd28b74324e5e91b94c32195c3b28" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
I20260924 17:36:22.009642 22276 raft_consensus.cc:3037] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:22.010259 22005 raft_consensus.cc:2454] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 1.
I20260924 17:36:22.010409 22276 raft_consensus.cc:2454] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 1.
I20260924 17:36:22.010432 22073 leader_election.cc:302] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14857379c67a4653b578843f794f98d1, a3b605cb098744c486cc667cabc33967; no voters:
I20260924 17:36:22.010599 22348 raft_consensus.cc:2781] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:22.010769 22348 raft_consensus.cc:686] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 1 LEADER]: Becoming Leader. State: Replica: a3b605cb098744c486cc667cabc33967, State: Running, Role: LEADER
I20260924 17:36:22.010854 22348 consensus_queue.cc:237] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:22.011813 21856 catalog_manager.cc:5495] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3b605cb098744c486cc667cabc33967 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "a3b605cb098744c486cc667cabc33967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } health_report { overall_health: UNKNOWN } } }
W20260924 17:36:22.017658 22053 tablet.cc:2369] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:36:22.026693 22188 tablet.cc:2369] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:36:22.027354 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:22.025004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42726 (local address 127.6.37.2:42619)
0924 17:36:22.025047 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:22.025049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:22.025062 (+ 13us) server_negotiation.cc:407] Connection header received
0924 17:36:22.025141 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:22.025142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:22.025161 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:22.025224 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:36:22.025332 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.025791 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.026514 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:22.026704 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:22.026864 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:22.027072 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:36:22.027169 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:36:22.027236 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:22.027267 (+ 31us) server_negotiation.cc:299] Negotiation successful
0924 17:36:22.027291 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:36:22.029098 22276 raft_consensus.cc:1261] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Refusing update from remote peer a3b605cb098744c486cc667cabc33967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:22.029160 22005 raft_consensus.cc:1261] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Refusing update from remote peer a3b605cb098744c486cc667cabc33967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:22.029453 22348 consensus_queue.cc:1035] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:22.029620 22351 consensus_queue.cc:1035] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:22.031985 22354 mvcc.cc:205] Tried to move back new op lower bound from 7332951580788416512 to 7332951580717465600. Current Snapshot: MvccSnapshot[applied={T|T < 7332951580788416512}]
I20260924 17:36:22.032778 22355 mvcc.cc:205] Tried to move back new op lower bound from 7332951580788416512 to 7332951580717465600. Current Snapshot: MvccSnapshot[applied={T|T < 7332951580788416512}]
I20260924 17:36:22.034058 21857 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:22.034152 21857 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:22.034973 21857 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Sending DeleteTablet for 3 replicas of tablet 2bbbd28b74324e5e91b94c32195c3b28
I20260924 17:36:22.035291 22120 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:42716
I20260924 17:36:22.035302 21985 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:49822
I20260924 17:36:22.035296 22256 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:55706
I20260924 17:36:22.035547 22364 tablet_replica.cc:330] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: stopping tablet replica
I20260924 17:36:22.035621 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 21922
I20260924 17:36:22.035647 22364 raft_consensus.cc:2229] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:22.035737 22364 raft_consensus.cc:2258] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:22.037866 22366 tablet_replica.cc:330] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: stopping tablet replica
I20260924 17:36:22.037985 22366 raft_consensus.cc:2229] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:36:22.038102 22366 raft_consensus.cc:2258] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:22.038481 22366 ts_tablet_manager.cc:1905] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:22.040274 22366 ts_tablet_manager.cc:1918] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:22.040380 22366 log.cc:1196] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/2bbbd28b74324e5e91b94c32195c3b28
I20260924 17:36:22.040645 22366 ts_tablet_manager.cc:1939] T 2bbbd28b74324e5e91b94c32195c3b28 P a3b605cb098744c486cc667cabc33967: Deleting consensus metadata
I20260924 17:36:22.041070 21843 catalog_manager.cc:4841] TS a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): tablet 2bbbd28b74324e5e91b94c32195c3b28 (table test-table [id=92e97ef2031e483ca4a852220c7f7c88]) successfully deleted
W20260924 17:36:22.042791 21841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:38217 (error 108)
I20260924 17:36:22.043344 22337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:22.043193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:38217 (local address 127.0.0.1:49830)
0924 17:36:22.043247 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:22.043284 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:38217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260924 17:36:22.043360 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22057
I20260924 17:36:22.043646 22364 ts_tablet_manager.cc:1905] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260924 17:36:22.044808 21841 catalog_manager.cc:4584] TS 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2bbbd28b74324e5e91b94c32195c3b28: Network error: Client connection negotiation failed: client connection to 127.6.37.1:38217: connect: Connection refused (error 111)
I20260924 17:36:22.044961 22364 ts_tablet_manager.cc:1918] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:22.045013 22364 log.cc:1196] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/2bbbd28b74324e5e91b94c32195c3b28
I20260924 17:36:22.045200 22364 ts_tablet_manager.cc:1939] T 2bbbd28b74324e5e91b94c32195c3b28 P 7c9f7e249edb4f8f9740d1f6a28b50ab: Deleting consensus metadata
I20260924 17:36:22.045564 21844 catalog_manager.cc:4841] TS 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): tablet 2bbbd28b74324e5e91b94c32195c3b28 (table test-table [id=92e97ef2031e483ca4a852220c7f7c88]) successfully deleted
I20260924 17:36:22.049918 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22192
I20260924 17:36:22.054750 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 21825
I20260924 17:36:42.060493 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38297
--webserver_interface=127.6.37.62
--webserver_port=39161
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:38297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:36:42.145888 22368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:42.146090 22368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:42.146114 22368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:42.147222 22368 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260924 17:36:42.147258 22368 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260924 17:36:42.147274 22368 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260924 17:36:42.147287 22368 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:36:42.147302 22368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:42.147317 22368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:42.147337 22368 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:36:42.147358 22368 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:36:42.148751 22368 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:38297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=39161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:42.148962 22368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:42.149127 22368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:42.158231 22377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.158231 22375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.158227 22374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:42.158262 22368 server_base.cc:1034] running on GCE node
I20260924 17:36:42.158735 22368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:42.159129 22368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:42.160296 22368 hybrid_clock.cc:648] HybridClock initialized: now 1790271402160278 us; error 28 us; skew 500 ppm
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:42.171188 22368 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:36:42.171671 22368 webserver.cc:460] Webserver started at http://127.6.37.62:39161/ using document root <none> and password file <none>
I20260924 17:36:42.171938 22368 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:42.172025 22368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:42.173626 22368 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 17:36:42.174307 22384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.174496 22368 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:36:42.174602 22368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "505ac02d757f4338a14beb624d336d0e"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "f589ff46d36c4087cfe377d1290633e5"
server_key_iv: "afa4e55182ea9650dae09e594864da54"
server_key_version: "encryptionkey@0"
I20260924 17:36:42.175064 22368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:42.189828 22368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:42.191653 22368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:42.191813 22368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:42.195735 22368 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:38297
I20260924 17:36:42.195801 22436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:38297 every 8 connection(s)
I20260924 17:36:42.196180 22368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:36:42.197639 22437 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:36:42.198293 22437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap starting.
I20260924 17:36:42.206099 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22368
I20260924 17:36:42.206403 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:38217
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:38297
--webserver_port=38931
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:36:42.206887 22437 log.cc:824] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:42.208735 22437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:36:42.209013 22437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap complete.
I20260924 17:36:42.211439 22437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:42.211685 22437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505ac02d757f4338a14beb624d336d0e, State: Initialized, Role: FOLLOWER
I20260924 17:36:42.211889 22437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:42.211985 22437 raft_consensus.cc:388] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:36:42.212046 22437 raft_consensus.cc:482] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:36:42.212095 22437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 1 FOLLOWER]: Advancing to term 2
I20260924 17:36:42.213064 22437 raft_consensus.cc:504] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:42.213182 22437 leader_election.cc:302] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 505ac02d757f4338a14beb624d336d0e; no voters:
I20260924 17:36:42.213370 22437 leader_election.cc:288] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260924 17:36:42.213405 22441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Leader election won for term 2
I20260924 17:36:42.213521 22441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 LEADER]: Becoming Leader. State: Replica: 505ac02d757f4338a14beb624d336d0e, State: Running, Role: LEADER
I20260924 17:36:42.213608 22441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:36:42.213649 22437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:36:42.213886 22443 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 505ac02d757f4338a14beb624d336d0e. Latest consensus state: current_term: 2 leader_uuid: "505ac02d757f4338a14beb624d336d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } } }
I20260924 17:36:42.214157 22443 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:42.214068 22442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "505ac02d757f4338a14beb624d336d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } } }
I20260924 17:36:42.214460 22442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: This master's current role is: LEADER
I20260924 17:36:42.214597 22451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:36:42.215480 22451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:36:42.215700 22451 catalog_manager.cc:1259] Loaded cluster ID: 8bb6c9b8488f4304be37ff8f7a72e932
I20260924 17:36:42.215862 22451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:36:42.217207 22451 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:36:42.217401 22451 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Loaded TSK: 0
I20260924 17:36:42.227331 22451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Generated new TSK 1
I20260924 17:36:42.227416 22451 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 17:36:42.291848 22440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:42.292053 22440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:42.292078 22440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:42.293291 22440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:42.293339 22440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:42.293367 22440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:36:42.294827 22440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:38217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=38931
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:42.295110 22440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:42.295367 22440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:42.301401 22468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.301411 22466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.301532 22465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:42.301877 22440 server_base.cc:1034] running on GCE node
I20260924 17:36:42.302145 22440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:42.302410 22440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:42.303591 22440 hybrid_clock.cc:648] HybridClock initialized: now 1790271402303570 us; error 34 us; skew 500 ppm
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:42.306190 22440 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:36:42.306677 22440 webserver.cc:460] Webserver started at http://127.6.37.1:38931/ using document root <none> and password file <none>
I20260924 17:36:42.306988 22440 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:42.307078 22440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:42.308538 22440 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:42.309361 22475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.309517 22440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:36:42.309643 22440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "14857379c67a4653b578843f794f98d1"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "0da19a2adde67fbf9d8d3e01e17f8d83"
server_key_iv: "1f915629ae1c8cdfa5c61b290ac8b41e"
server_key_version: "encryptionkey@0"
I20260924 17:36:42.310055 22440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:42.328896 22440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:42.331399 22440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:42.331579 22440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:42.331873 22440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:42.332355 22482 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260924 17:36:42.334161 22440 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260924 17:36:42.334252 22440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260924 17:36:42.334301 22440 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260924 17:36:42.335026 22440 ts_tablet_manager.cc:610] Registered 1 tablets
I20260924 17:36:42.335080 22440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:42.335136 22482 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Bootstrap starting.
I20260924 17:36:42.342264 22440 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:38217
I20260924 17:36:42.342398 22592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:38217 every 8 connection(s)
I20260924 17:36:42.342705 22440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:36:42.345978 22482 log.cc:824] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:42.348372 22482 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:36:42.348697 22482 tablet_bootstrap.cc:492] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Bootstrap complete.
I20260924 17:36:42.349845 22482 ts_tablet_manager.cc:1397] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.006s
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:42.351078 22482 raft_consensus.cc:348] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:42.351423 22482 raft_consensus.cc:729] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14857379c67a4653b578843f794f98d1, State: Initialized, Role: FOLLOWER
I20260924 17:36:42.351562 22482 consensus_queue.cc:260] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } }
I20260924 17:36:42.351886 22482 ts_tablet_manager.cc:1428] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260924 17:36:42.351908 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22440
I20260924 17:36:42.352213 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:42619
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:38297
--webserver_port=43051
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:36:42.354393 22596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.343404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:39735)
0924 17:36:42.343599 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.343642 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.344110 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.344645 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.344649 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.344891 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:42.345103 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.345107 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.346704 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.346705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.347565 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.347567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.348344 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.348345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.348504 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.349063 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:42.349071 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:42.350666 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:42.352667 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:42.352674 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:42.352677 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:42.352987 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:42.353224 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:42.353225 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:42.353225 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:42.353362 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:42.353838 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:42.353844 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:42.353955 (+ 111us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.354040 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.354158 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":116,"threads_started":1}
I20260924 17:36:42.354508 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.343521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:39735 (local address 127.6.37.62:38297)
0924 17:36:42.343752 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.343761 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.343802 (+ 41us) server_negotiation.cc:407] Connection header received
0924 17:36:42.344358 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.344368 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.344442 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.344622 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:42.345239 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.346580 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.347662 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.348235 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.348348 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.350770 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:42.350774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:42.350775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:42.350787 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:42.352582 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.353068 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.353071 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.353071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.353157 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.353453 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.353454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.353455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.353764 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:42.353858 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.354124 (+ 266us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.354274 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":115,"threads_started":1}
I20260924 17:36:42.355103 22593 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38297
I20260924 17:36:42.355213 22593 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:42.355383 22593 heartbeater.cc:511] Master 127.6.37.62:38297 requested a full tablet report, sending...
I20260924 17:36:42.356101 22401 ts_manager.cc:194] Registered new tserver with Master: 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217)
I20260924 17:36:42.357117 22401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:39735
I20260924 17:36:42.357856 22593 heartbeater.cc:503] Master 127.6.37.62:38297 was elected leader, sending a full tablet report...
I20260924 17:36:42.362625 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.356643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:38217 (local address 127.0.0.1:33720)
0924 17:36:42.359014 (+ 2371us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.359041 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.359103 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.359281 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.359284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.359285 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:42.359330 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.359331 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.360611 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.360612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.361377 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.361380 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.362393 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.362394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.362471 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.362482 (+ 11us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.362536 (+ 54us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.362576 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2344,"thread_start_us":81,"threads_started":1}
I20260924 17:36:42.362682 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.356723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.6.37.1:38217)
0924 17:36:42.356869 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.356873 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.359115 (+ 2242us) server_negotiation.cc:407] Connection header received
0924 17:36:42.359163 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.359166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.359185 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.359277 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:42.359375 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.360519 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.361461 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.362279 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.362385 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.362456 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.362550 (+ 94us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.362597 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260924 17:36:42.363095 22526 tablet_service.cc:1514] Processing DeleteTablet for tablet 2bbbd28b74324e5e91b94c32195c3b28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:33720
I20260924 17:36:42.363690 22603 tablet_replica.cc:330] stopping tablet replica
I20260924 17:36:42.363811 22603 raft_consensus.cc:2229] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:42.363888 22603 raft_consensus.cc:2258] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:42.364205 22603 ts_tablet_manager.cc:1905] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:42.366321 22603 ts_tablet_manager.cc:1918] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:42.366407 22603 log.cc:1196] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal/wals/2bbbd28b74324e5e91b94c32195c3b28
I20260924 17:36:42.366639 22603 ts_tablet_manager.cc:1939] T 2bbbd28b74324e5e91b94c32195c3b28 P 14857379c67a4653b578843f794f98d1: Deleting consensus metadata
I20260924 17:36:42.367195 22385 catalog_manager.cc:4841] TS 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217): tablet 2bbbd28b74324e5e91b94c32195c3b28 (table test-table [id=92e97ef2031e483ca4a852220c7f7c88]) successfully deleted
W20260924 17:36:42.454454 22600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:42.454648 22600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:42.454670 22600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:42.455888 22600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:42.455945 22600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:42.455997 22600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:36:42.457427 22600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:42619
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=43051
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:42.457669 22600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:42.457926 22600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:42.462922 22608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.462939 22609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.462922 22611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:42.463233 22600 server_base.cc:1034] running on GCE node
I20260924 17:36:42.463447 22600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:42.463691 22600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:42.464854 22600 hybrid_clock.cc:648] HybridClock initialized: now 1790271402464821 us; error 67 us; skew 500 ppm
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:42.467373 22600 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:36:42.467844 22600 webserver.cc:460] Webserver started at http://127.6.37.2:43051/ using document root <none> and password file <none>
I20260924 17:36:42.468103 22600 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:42.468186 22600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:42.469506 22600 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:42.470059 22618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.470227 22600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:42.470316 22600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "a3b605cb098744c486cc667cabc33967"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "4aca59d693e4e7ce12aa26569b427dd6"
server_key_iv: "a4181b4b4c61bf014a4feb9ec92c4f2c"
server_key_version: "encryptionkey@0"
I20260924 17:36:42.470670 22600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:42.484262 22600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:42.486681 22600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:42.486847 22600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:42.487157 22600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:42.487488 22600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:42.487542 22600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.487582 22600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:42.487627 22600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.493305 22600 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:42619
I20260924 17:36:42.493357 22732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:42619 every 8 connection(s)
I20260924 17:36:42.493693 22600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:36:42.498103 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22600
I20260924 17:36:42.498446 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:38953
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:38297
--webserver_port=46853
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:42.503369 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.494434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:47745 (local address 127.6.37.62:38297)
0924 17:36:42.494495 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.494498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.494707 (+ 209us) server_negotiation.cc:407] Connection header received
0924 17:36:42.495197 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.495198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.495211 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.495267 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:42.496148 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.496646 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.497733 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.497949 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.498001 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.500398 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:42.500399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:42.500400 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:42.500408 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:42.501806 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.502308 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.502309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.502309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.502382 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.502681 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.502681 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.502681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.502782 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:42.502831 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.503234 (+ 403us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.503305 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:36:42.503686 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.494411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:47745)
0924 17:36:42.494574 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.494616 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.495113 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.495320 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.495323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.495871 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:42.496068 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.496072 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.496778 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.496780 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.497651 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.497654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.498036 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.498037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.498187 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.498744 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:42.498753 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:42.500305 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:42.501887 (+ 1582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:42.501894 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:42.501896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:42.502228 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:42.502455 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:42.502456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:42.502457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:42.502609 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:42.502850 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:42.502858 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:42.503090 (+ 232us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.503220 (+ 130us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.503406 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260924 17:36:42.504243 22733 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38297
I20260924 17:36:42.504336 22733 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:42.504542 22733 heartbeater.cc:511] Master 127.6.37.62:38297 requested a full tablet report, sending...
I20260924 17:36:42.504938 22401 ts_manager.cc:194] Registered new tserver with Master: a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
I20260924 17:36:42.505259 22401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:47745
W20260924 17:36:42.581292 22736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:36:42.581523 22736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:36:42.581562 22736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:36:42.582677 22736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:36:42.582746 22736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:36:42.582792 22736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:36:42.584228 22736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:38953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=46853
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:36:42.584502 22736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:36:42.584717 22736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:36:42.589659 22744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:36:42.589636 22742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:42.589710 22736 server_base.cc:1034] running on GCE node
W20260924 17:36:42.589648 22741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:36:42.590113 22736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:36:42.590299 22736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:36:42.591439 22736 hybrid_clock.cc:648] HybridClock initialized: now 1790271402591426 us; error 28 us; skew 500 ppm
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:36:42.593780 22736 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:36:42.594215 22736 webserver.cc:460] Webserver started at http://127.6.37.3:46853/ using document root <none> and password file <none>
I20260924 17:36:42.594385 22736 fs_manager.cc:359] Metadata directory not provided
I20260924 17:36:42.594444 22736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:36:42.595777 22736 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:42.596323 22751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.596496 22736 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:42.596578 22736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "b685887d83395c7a13a4d3a739bac25a"
server_key_iv: "66f0d570e9a2768c93a74002692b7a72"
server_key_version: "encryptionkey@0"
I20260924 17:36:42.596869 22736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:36:42.624557 22736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:36:42.626415 22736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:36:42.626540 22736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:36:42.626730 22736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:36:42.627030 22736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:36:42.627061 22736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.627084 22736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:36:42.627097 22736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:36:42.632738 22736 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38953
I20260924 17:36:42.632818 22866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38953 every 8 connection(s)
I20260924 17:36:42.633142 22736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:36:42.634123 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22736
Sep 24 17:36:42 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271402, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:36:42.641734 22871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.634520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60884 (local address 127.6.37.62:38297)
0924 17:36:42.634884 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.634886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.634893 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:36:42.634917 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.634918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.634930 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.634983 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:42.635569 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.636276 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.637157 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.637485 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.637557 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.639010 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:42.639011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:42.639011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:42.639018 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:42.640550 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.640897 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.640898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.640899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.640964 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.641167 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.641168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.641169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.641283 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:42.641480 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.641517 (+ 37us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.641628 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":70,"threads_started":1}
I20260924 17:36:42.643286 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.633894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:49797 (local address 127.6.37.62:38297)
0924 17:36:42.634007 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.634010 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.634227 (+ 217us) server_negotiation.cc:407] Connection header received
0924 17:36:42.634809 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.634810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.634820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.634903 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:42.636042 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.636648 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.637855 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.638044 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.638124 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.640510 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:42.640515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:42.640516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:42.640522 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:42.642026 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.642467 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.642468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.642469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.642527 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.642769 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.642770 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.642770 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.642863 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:42.642962 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.643169 (+ 207us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.643227 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 17:36:42.643537 22869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.633872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:49797)
0924 17:36:42.634056 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.634100 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.634696 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.635002 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.635007 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.635669 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:36:42.635948 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.635955 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.636738 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.636739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.637773 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.637775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.638139 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.638141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.638255 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.638747 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:36:42.638754 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:36:42.640401 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:36:42.642091 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:42.642098 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:42.642101 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:42.642391 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:42.642600 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:36:42.642601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:36:42.642601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:36:42.642709 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:36:42.642949 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:36:42.642953 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:36:42.643071 (+ 118us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.643154 (+ 83us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.643269 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
I20260924 17:36:42.644001 22867 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38297
I20260924 17:36:42.644109 22867 heartbeater.cc:464] Registering TS with master...
I20260924 17:36:42.644296 22867 heartbeater.cc:511] Master 127.6.37.62:38297 requested a full tablet report, sending...
I20260924 17:36:42.644675 22401 ts_manager.cc:194] Registered new tserver with Master: 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953)
I20260924 17:36:42.645056 22401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:49797
I20260924 17:36:42.653216 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:36:42.655898 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.653598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.6.37.62:38297)
0924 17:36:42.653662 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.653664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.653766 (+ 102us) server_negotiation.cc:407] Connection header received
0924 17:36:42.653827 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.653828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.653863 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.653926 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:36:42.654055 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.654528 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.655322 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.655504 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.655554 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.655684 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:36:42.655729 (+ 45us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0924 17:36:42.655848 (+ 119us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60894: token expired
Metrics: {"server-negotiator.queue_time_us":41}
W20260924 17:36:42.655972 22597 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60894: token expired
W20260924 17:36:42.656211 22329 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.37.62:38297)
I20260924 17:36:42.661953 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.656480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60896 (local address 127.6.37.62:38297)
0924 17:36:42.656542 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.656544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.656552 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:36:42.656622 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.656624 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.656633 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.656681 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:36:42.657169 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.657610 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.658296 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.658484 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.658562 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.659730 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:36:42.659732 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:36:42.659732 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:36:42.659739 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:36:42.660852 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.661187 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.661188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.661188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.661245 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:36:42.661439 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:36:42.661440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:36:42.661440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:36:42.661576 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:36:42.661683 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.661783 (+ 100us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.661857 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:36:42.663061 22401 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:36:42.664690 22401 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:36:42.667097 22526 tablet_service.cc:1467] Processing CreateTablet for tablet 24316ca8610c426b9026684b354f877f (DEFAULT_TABLE table=test-table [id=e73f9a7e54ea4414aa942cdcda04eb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:42.667321 22526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24316ca8610c426b9026684b354f877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:42.668710 22482 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Bootstrap starting.
I20260924 17:36:42.669039 22482 tablet_bootstrap.cc:654] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:42.669629 22482 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: No bootstrap required, opened a new log
I20260924 17:36:42.669677 22482 ts_tablet_manager.cc:1397] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260924 17:36:42.669781 22482 raft_consensus.cc:348] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.669862 22482 raft_consensus.cc:374] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:42.669922 22482 raft_consensus.cc:729] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14857379c67a4653b578843f794f98d1, State: Initialized, Role: FOLLOWER
I20260924 17:36:42.669981 22482 consensus_queue.cc:260] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.670071 22482 ts_tablet_manager.cc:1428] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260924 17:36:42.670962 22873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.666576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38953 (local address 127.0.0.1:50470)
0924 17:36:42.666753 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.666762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.666810 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.667234 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.667235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.667237 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:42.667280 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.667281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.668662 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.668663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.669801 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.669804 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.670687 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.670687 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.670752 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.670756 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.670813 (+ 57us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.670855 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":21,"thread_start_us":111,"threads_started":1}
I20260924 17:36:42.670959 22875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.666857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50470 (local address 127.6.37.3:38953)
0924 17:36:42.667066 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.667070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.667081 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:36:42.667118 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.667120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.667134 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.667356 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:42.667458 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.668572 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.669903 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.670618 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.670687 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.670749 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.670828 (+ 79us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.670864 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":109,"threads_started":1}
I20260924 17:36:42.671651 22799 tablet_service.cc:1467] Processing CreateTablet for tablet 24316ca8610c426b9026684b354f877f (DEFAULT_TABLE table=test-table [id=e73f9a7e54ea4414aa942cdcda04eb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:42.672001 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.666575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:42619 (local address 127.0.0.1:55536)
0924 17:36:42.666712 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.666723 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.666764 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.667154 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.667155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.667156 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:42.667194 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.667196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.669902 (+ 2706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.669903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.670858 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.670861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.671788 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.671789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.671847 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.671851 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.671880 (+ 29us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.671918 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260924 17:36:42.672010 22799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24316ca8610c426b9026684b354f877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:42.672329 22874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.666745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.6.37.2:42619)
0924 17:36:42.666958 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.666963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.666988 (+ 25us) server_negotiation.cc:407] Connection header received
0924 17:36:42.667033 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.667036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.667051 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.667142 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:42.667268 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.668568 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.670966 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.671685 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.672119 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.672185 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.672212 (+ 27us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.672253 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":96,"threads_started":1}
I20260924 17:36:42.672942 22666 tablet_service.cc:1467] Processing CreateTablet for tablet 24316ca8610c426b9026684b354f877f (DEFAULT_TABLE table=test-table [id=e73f9a7e54ea4414aa942cdcda04eb79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:36:42.673228 22666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24316ca8610c426b9026684b354f877f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:36:42.675277 22877 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Bootstrap starting.
I20260924 17:36:42.675940 22877 tablet_bootstrap.cc:654] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:42.676540 22877 log.cc:824] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:42.676731 22878 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Bootstrap starting.
I20260924 17:36:42.677266 22878 tablet_bootstrap.cc:654] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Neither blocks nor log segments found. Creating new log.
I20260924 17:36:42.677323 22877 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: No bootstrap required, opened a new log
I20260924 17:36:42.677407 22877 ts_tablet_manager.cc:1397] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:42.677856 22878 log.cc:824] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Log is configured to *not* fsync() on all Append() calls
I20260924 17:36:42.678644 22878 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: No bootstrap required, opened a new log
I20260924 17:36:42.678721 22878 ts_tablet_manager.cc:1397] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:36:42.679018 22877 raft_consensus.cc:348] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.679152 22877 raft_consensus.cc:374] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:42.679172 22877 raft_consensus.cc:729] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c9f7e249edb4f8f9740d1f6a28b50ab, State: Initialized, Role: FOLLOWER
I20260924 17:36:42.679282 22877 consensus_queue.cc:260] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.679566 22877 ts_tablet_manager.cc:1428] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:36:42.679615 22867 heartbeater.cc:503] Master 127.6.37.62:38297 was elected leader, sending a full tablet report...
I20260924 17:36:42.680716 22878 raft_consensus.cc:348] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.680873 22878 raft_consensus.cc:374] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:36:42.680918 22878 raft_consensus.cc:729] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3b605cb098744c486cc667cabc33967, State: Initialized, Role: FOLLOWER
I20260924 17:36:42.681030 22878 consensus_queue.cc:260] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.681321 22878 ts_tablet_manager.cc:1428] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:36:42.681344 22733 heartbeater.cc:503] Master 127.6.37.62:38297 was elected leader, sending a full tablet report...
I20260924 17:36:42.698282 22882 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:36:42.698366 22882 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.698721 22882 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217)
I20260924 17:36:42.701599 22883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.698873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:38217 (local address 127.6.37.2:38289)
0924 17:36:42.699074 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.699083 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.699142 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.699279 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.699280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.699281 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:42.699370 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.699372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.699970 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.699971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.700843 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.700846 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.701345 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.701346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.701414 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.701418 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.701475 (+ 57us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.701502 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":36,"thread_start_us":93,"threads_started":1}
I20260924 17:36:42.701615 22602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.698977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:38289 (local address 127.6.37.1:38217)
0924 17:36:42.699024 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.699027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.699153 (+ 126us) server_negotiation.cc:407] Connection header received
0924 17:36:42.699186 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.699187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.699214 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.699271 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:42.699431 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.699864 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.700938 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.701273 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.701324 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.701332 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.701502 (+ 170us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.701550 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260924 17:36:42.701661 22875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.698990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:41181 (local address 127.6.37.3:38953)
0924 17:36:42.699041 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.699043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.699052 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:36:42.699078 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.699079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.699092 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.699150 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:36:42.699331 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.699841 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.700943 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.701293 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.701373 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.701382 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.701557 (+ 175us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.701591 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260924 17:36:42.701694 22735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.698856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38953 (local address 127.6.37.2:41181)
0924 17:36:42.698946 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.698958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:36:42.699001 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:36:42.699168 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:36:42.699169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:36:42.699171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:36:42.699261 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.699262 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.699916 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.699917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.700842 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:36:42.700845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.701388 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.701391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:36:42.701478 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.701482 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:36:42.701537 (+ 55us) client_negotiation.cc:240] Negotiation successful
0924 17:36:42.701571 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"mutex_wait_us":58}
I20260924 17:36:42.701928 22546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24316ca8610c426b9026684b354f877f" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14857379c67a4653b578843f794f98d1" is_pre_election: true
I20260924 17:36:42.701982 22820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24316ca8610c426b9026684b354f877f" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" is_pre_election: true
I20260924 17:36:42.702101 22820 raft_consensus.cc:2454] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 0.
I20260924 17:36:42.702103 22546 raft_consensus.cc:2454] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 0.
I20260924 17:36:42.702304 22622 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967; no voters:
I20260924 17:36:42.702452 22882 raft_consensus.cc:2781] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:36:42.702507 22882 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:36:42.702527 22882 raft_consensus.cc:3037] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:42.703243 22882 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.703374 22882 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 election: Requested vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217)
I20260924 17:36:42.703547 22820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24316ca8610c426b9026684b354f877f" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
I20260924 17:36:42.703612 22820 raft_consensus.cc:3037] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:42.704257 22820 raft_consensus.cc:2454] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 1.
I20260924 17:36:42.704376 22546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24316ca8610c426b9026684b354f877f" candidate_uuid: "a3b605cb098744c486cc667cabc33967" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14857379c67a4653b578843f794f98d1"
I20260924 17:36:42.704406 22622 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967; no voters:
I20260924 17:36:42.704461 22546 raft_consensus.cc:3037] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:36:42.704504 22882 raft_consensus.cc:2781] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:36:42.704633 22882 raft_consensus.cc:686] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 1 LEADER]: Becoming Leader. State: Replica: a3b605cb098744c486cc667cabc33967, State: Running, Role: LEADER
I20260924 17:36:42.704722 22882 consensus_queue.cc:237] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:36:42.705583 22401 catalog_manager.cc:5495] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3b605cb098744c486cc667cabc33967 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "a3b605cb098744c486cc667cabc33967" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } health_report { overall_health: UNKNOWN } } }
I20260924 17:36:42.705760 22546 raft_consensus.cc:2454] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3b605cb098744c486cc667cabc33967 in term 1.
I20260924 17:36:42.715848 22874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.713254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55548 (local address 127.6.37.2:42619)
0924 17:36:42.713309 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0924 17:36:42.713311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:36:42.713319 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:36:42.713394 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:36:42.713395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:36:42.713426 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:36:42.713513 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:36:42.713636 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.714141 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.715029 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:36:42.715250 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:36:42.715333 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:36:42.715501 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:36:42.715601 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:36:42.715710 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0924 17:36:42.715727 (+ 17us) server_negotiation.cc:299] Negotiation successful
0924 17:36:42.715746 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 17:36:42.717476 22820 raft_consensus.cc:1261] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Refusing update from remote peer a3b605cb098744c486cc667cabc33967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:42.717506 22546 raft_consensus.cc:1261] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Refusing update from remote peer a3b605cb098744c486cc667cabc33967: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:36:42.717832 22882 consensus_queue.cc:1035] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:42.717993 22884 consensus_queue.cc:1035] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:36:42.719856 22886 mvcc.cc:205] Tried to move back new op lower bound from 7332951665528041472 to 7332951665479073792. Current Snapshot: MvccSnapshot[applied={T|T < 7332951665528041472}]
I20260924 17:36:42.720340 22888 mvcc.cc:205] Tried to move back new op lower bound from 7332951665528041472 to 7332951665479073792. Current Snapshot: MvccSnapshot[applied={T|T < 7332951665528041472}]
I20260924 17:36:42.720606 22887 mvcc.cc:205] Tried to move back new op lower bound from 7332951665528041472 to 7332951665479073792. Current Snapshot: MvccSnapshot[applied={T|T < 7332951665528041472}]
I20260924 17:36:42.722597 22400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:42.722695 22400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:36:42.723459 22400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Sending DeleteTablet for 3 replicas of tablet 24316ca8610c426b9026684b354f877f
I20260924 17:36:42.723768 22526 tablet_service.cc:1514] Processing DeleteTablet for tablet 24316ca8610c426b9026684b354f877f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:42 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:33720
I20260924 17:36:42.723762 22666 tablet_service.cc:1514] Processing DeleteTablet for tablet 24316ca8610c426b9026684b354f877f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:42 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:55536
I20260924 17:36:42.723877 22603 tablet_replica.cc:330] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: stopping tablet replica
I20260924 17:36:42.723922 22603 raft_consensus.cc:2229] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:42.723981 22896 tablet_replica.cc:330] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: stopping tablet replica
I20260924 17:36:42.723992 22603 raft_consensus.cc:2258] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:42.724071 22896 raft_consensus.cc:2229] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:36:42.724184 22896 raft_consensus.cc:2258] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:42.724251 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22440
I20260924 17:36:42.724251 22799 tablet_service.cc:1514] Processing DeleteTablet for tablet 24316ca8610c426b9026684b354f877f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:36:42 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:50470
I20260924 17:36:42.725145 22896 ts_tablet_manager.cc:1905] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:36:42.727089 22896 ts_tablet_manager.cc:1918] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:42.727162 22896 log.cc:1196] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/24316ca8610c426b9026684b354f877f
I20260924 17:36:42.727443 22896 ts_tablet_manager.cc:1939] T 24316ca8610c426b9026684b354f877f P a3b605cb098744c486cc667cabc33967: Deleting consensus metadata
I20260924 17:36:42.727816 22387 catalog_manager.cc:4841] TS a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): tablet 24316ca8610c426b9026684b354f877f (table test-table [id=e73f9a7e54ea4414aa942cdcda04eb79]) successfully deleted
W20260924 17:36:42.730785 22385 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:38217 (error 108)
I20260924 17:36:42.731072 22897 tablet_replica.cc:330] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: stopping tablet replica
I20260924 17:36:42.731189 22897 raft_consensus.cc:2229] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:36:42.731287 22601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:36:42.731172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:38217 (local address 127.0.0.1:33722)
0924 17:36:42.731218 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0924 17:36:42.731258 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:38217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260924 17:36:42.731302 22897 raft_consensus.cc:2258] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:36:42.731488 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22600
I20260924 17:36:42.731775 22897 ts_tablet_manager.cc:1905] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260924 17:36:42.731402 22385 catalog_manager.cc:4584] TS 14857379c67a4653b578843f794f98d1 (127.6.37.1:38217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 24316ca8610c426b9026684b354f877f: Network error: Client connection negotiation failed: client connection to 127.6.37.1:38217: connect: Connection refused (error 111)
I20260924 17:36:42.734097 22897 ts_tablet_manager.cc:1918] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:36:42.734157 22897 log.cc:1196] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/24316ca8610c426b9026684b354f877f
I20260924 17:36:42.734436 22897 ts_tablet_manager.cc:1939] T 24316ca8610c426b9026684b354f877f P 7c9f7e249edb4f8f9740d1f6a28b50ab: Deleting consensus metadata
I20260924 17:36:42.734808 22388 catalog_manager.cc:4841] TS 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): tablet 24316ca8610c426b9026684b354f877f (table test-table [id=e73f9a7e54ea4414aa942cdcda04eb79]) successfully deleted
I20260924 17:36:42.736946 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22736
I20260924 17:36:42.741677 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22368
I20260924 17:37:02.746945 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38297
--webserver_interface=127.6.37.62
--webserver_port=39161
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:38297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:02.828263 22899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:02.828485 22899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:02.828522 22899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:02.829627 22899 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260924 17:37:02.829689 22899 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260924 17:37:02.829710 22899 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260924 17:37:02.829730 22899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:02.829763 22899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:02.829789 22899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:02.829821 22899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:02.829849 22899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:02.831315 22899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:38297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=39161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:02.831581 22899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:02.831797 22899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:02.836573 22905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:02.836705 22899 server_base.cc:1034] running on GCE node
W20260924 17:37:02.836586 22904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:02.836555 22907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:02.837098 22899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:02.837388 22899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:02.838557 22899 hybrid_clock.cc:648] HybridClock initialized: now 1790271422838538 us; error 36 us; skew 500 ppm
Sep 24 17:37:02 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271422, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:02.841020 22899 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:02.841473 22899 webserver.cc:460] Webserver started at http://127.6.37.62:39161/ using document root <none> and password file <none>
I20260924 17:37:02.841696 22899 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:02.841765 22899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:02.843115 22899 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:37:02.843870 22914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:02.844059 22899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260924 17:37:02.844165 22899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "505ac02d757f4338a14beb624d336d0e"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "f589ff46d36c4087cfe377d1290633e5"
server_key_iv: "afa4e55182ea9650dae09e594864da54"
server_key_version: "encryptionkey@0"
I20260924 17:37:02.844501 22899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:02.856606 22899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:02.858469 22899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:02.858626 22899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:02.862766 22899 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:38297
I20260924 17:37:02.862814 22967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:38297 every 8 connection(s)
I20260924 17:37:02.863224 22899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:02.864674 22968 sys_catalog.cc:263] Verifying existing consensus state
I20260924 17:37:02.865347 22968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap starting.
I20260924 17:37:02.872237 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22899
I20260924 17:37:02.872591 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:38217
--local_ip_for_outbound_sockets=127.6.37.1
--tserver_master_addrs=127.6.37.62:38297
--webserver_port=38931
--webserver_interface=127.6.37.1
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:02.874593 22968 log.cc:824] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:02.876953 22968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:37:02.877250 22968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Bootstrap complete.
I20260924 17:37:02.879550 22968 raft_consensus.cc:348] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:37:02.879763 22968 raft_consensus.cc:729] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505ac02d757f4338a14beb624d336d0e, State: Initialized, Role: FOLLOWER
I20260924 17:37:02.879925 22968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:37:02.879984 22968 raft_consensus.cc:388] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:02.880043 22968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:02.880087 22968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 2 FOLLOWER]: Advancing to term 3
I20260924 17:37:02.881045 22968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:37:02.881129 22968 leader_election.cc:302] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 505ac02d757f4338a14beb624d336d0e; no voters:
I20260924 17:37:02.881309 22968 leader_election.cc:288] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260924 17:37:02.881347 22972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 3 FOLLOWER]: Leader election won for term 3
I20260924 17:37:02.881459 22972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [term 3 LEADER]: Becoming Leader. State: Replica: 505ac02d757f4338a14beb624d336d0e, State: Running, Role: LEADER
I20260924 17:37:02.881585 22968 sys_catalog.cc:564] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:02.881603 22972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } }
I20260924 17:37:02.881974 22973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "505ac02d757f4338a14beb624d336d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } } }
I20260924 17:37:02.882066 22973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:02.882259 22974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 505ac02d757f4338a14beb624d336d0e. Latest consensus state: current_term: 3 leader_uuid: "505ac02d757f4338a14beb624d336d0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505ac02d757f4338a14beb624d336d0e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38297 } } }
I20260924 17:37:02.882349 22974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:02.882647 22980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:02.883455 22980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:02.883617 22980 catalog_manager.cc:1259] Loaded cluster ID: 8bb6c9b8488f4304be37ff8f7a72e932
I20260924 17:37:02.883785 22980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:02.884990 22980 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:02.885154 22980 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Loaded TSK: 0
I20260924 17:37:02.885186 22980 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 505ac02d757f4338a14beb624d336d0e: Loaded TSK: 1
F20260924 17:37:02.885416 22980 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f80776d19ad google::LogMessage::Fail() at ??:0
@ 0x7f80776d488a google::LogMessage::SendToLog() at ??:0
@ 0x7f80776d14de google::LogMessage::Flush() at ??:0
@ 0x7f80776d2a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8079e3e104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8079e3bd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f807f62b1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f807f62b48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f807f62b594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f807f5f1c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f807f5fbad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f807959f0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8079594954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f807a3f86db start_thread at ??:0
@ 0x7f80761cf61f clone at ??:0
W20260924 17:37:02.971722 22970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:02.971951 22970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:02.971998 22970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:02.973168 22970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:02.973229 22970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:02.973273 22970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:02.974818 22970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:38217
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=38931
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:02.975106 22970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:02.975392 22970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:02.980692 23010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:02.980741 23011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:02.980896 22970 server_base.cc:1034] running on GCE node
W20260924 17:37:02.980711 23013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:02.981253 22970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:02.981556 22970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:02.982749 22970 hybrid_clock.cc:648] HybridClock initialized: now 1790271422982728 us; error 38 us; skew 500 ppm
Sep 24 17:37:02 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271422, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:02.985494 22970 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:37:02.986021 22970 webserver.cc:460] Webserver started at http://127.6.37.1:38931/ using document root <none> and password file <none>
I20260924 17:37:02.986284 22970 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:02.986385 22970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:02.987963 22970 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:02.988752 23020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:02.989089 22970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:02.989192 22970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "14857379c67a4653b578843f794f98d1"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "0da19a2adde67fbf9d8d3e01e17f8d83"
server_key_iv: "1f915629ae1c8cdfa5c61b290ac8b41e"
server_key_version: "encryptionkey@0"
I20260924 17:37:02.989593 22970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:02.998222 22970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:03.000528 22970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:03.000684 22970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:03.000944 22970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:03.001398 23027 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260924 17:37:03.003397 22970 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260924 17:37:03.003463 22970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260924 17:37:03.003508 22970 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260924 17:37:03.004168 22970 ts_tablet_manager.cc:610] Registered 1 tablets
I20260924 17:37:03.004225 22970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260924 17:37:03.004288 23027 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Bootstrap starting.
I20260924 17:37:03.011494 22970 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:38217
I20260924 17:37:03.011626 23136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:38217 every 8 connection(s)
I20260924 17:37:03.011916 22970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:03.015427 23027 log.cc:824] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:03.018064 23027 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260924 17:37:03.018323 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 22970
I20260924 17:37:03.018373 23027 tablet_bootstrap.cc:492] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Bootstrap complete.
I20260924 17:37:03.018615 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:42619
--local_ip_for_outbound_sockets=127.6.37.2
--tserver_master_addrs=127.6.37.62:38297
--webserver_port=43051
--webserver_interface=127.6.37.2
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:03.019677 23027 ts_tablet_manager.cc:1397] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.010s
I20260924 17:37:03.021114 23027 raft_consensus.cc:348] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:03.021437 23027 raft_consensus.cc:729] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14857379c67a4653b578843f794f98d1, State: Initialized, Role: FOLLOWER
I20260924 17:37:03.021597 23027 consensus_queue.cc:260] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:03.021909 23027 ts_tablet_manager.cc:1428] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
W20260924 17:37:03.084681 23139 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:03.012656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:35415)
0924 17:37:03.012827 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.012869 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:03.013311 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:03.084440 (+ 71129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":98,"threads_started":1}
W20260924 17:37:03.085009 23137 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:38297 (0 consecutive failures): Network error: Failed to ping master at 127.6.37.62:38297: Client connection negotiation failed: client connection to 127.6.37.62:38297: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260924 17:37:03.085413 23139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.085263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:36987)
0924 17:37:03.085327 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.085381 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260924 17:37:03.085764 23139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.085652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:53527)
0924 17:37:03.085700 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.085739 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:37:03.085898 23137 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:37:03.102972 23141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:03.103163 23141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:03.103186 23141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:03.104390 23141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:03.104431 23141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:03.104457 23141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:03.105904 23141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:42619
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=43051
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:03.106139 23141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:03.106371 23141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:03.111264 23147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:03.111351 23148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:03.111264 23150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:03.111524 23141 server_base.cc:1034] running on GCE node
I20260924 17:37:03.111737 23141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:03.112004 23141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:03.113179 23141 hybrid_clock.cc:648] HybridClock initialized: now 1790271423113154 us; error 53 us; skew 500 ppm
Sep 24 17:37:03 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271423, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:03.115610 23141 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:37:03.116060 23141 webserver.cc:460] Webserver started at http://127.6.37.2:43051/ using document root <none> and password file <none>
I20260924 17:37:03.116302 23141 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:03.116369 23141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:03.117661 23141 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:03.118233 23157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.118418 23141 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:03.118523 23141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "a3b605cb098744c486cc667cabc33967"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "4aca59d693e4e7ce12aa26569b427dd6"
server_key_iv: "a4181b4b4c61bf014a4feb9ec92c4f2c"
server_key_version: "encryptionkey@0"
I20260924 17:37:03.118852 23141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:03.134480 23141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:03.136394 23141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:03.136549 23141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:03.136777 23141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:03.137082 23141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:03.137137 23141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.137180 23141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:03.137208 23141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.143049 23141 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:42619
I20260924 17:37:03.143118 23273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:42619 every 8 connection(s)
I20260924 17:37:03.143447 23141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:37:03.143868 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 23141
I20260924 17:37:03.144167 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:38953
--local_ip_for_outbound_sockets=127.6.37.3
--tserver_master_addrs=127.6.37.62:38297
--webserver_port=46853
--webserver_interface=127.6.37.3
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:03.144609 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.144124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:60849)
0924 17:37:03.144329 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.144416 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
W20260924 17:37:03.145092 23274 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:38297 (0 consecutive failures): Network error: Failed to ping master at 127.6.37.62:38297: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
I20260924 17:37:03.145383 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.145276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:56323)
0924 17:37:03.145330 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.145360 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260924 17:37:03.145738 23276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.145639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:51701)
0924 17:37:03.145689 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.145714 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:37:03.145872 23274 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260924 17:37:03.226584 23277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:03.226788 23277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:03.226819 23277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:03.228171 23277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:03.228214 23277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:03.228240 23277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:03.229652 23277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:38953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=46853
--tserver_master_addrs=127.6.37.62:38297
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:03.229839 23277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:03.230015 23277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:03.234978 23282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:03.235055 23285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:03.234980 23283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:03.235299 23277 server_base.cc:1034] running on GCE node
I20260924 17:37:03.235519 23277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:03.235729 23277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:03.236872 23277 hybrid_clock.cc:648] HybridClock initialized: now 1790271423236848 us; error 38 us; skew 500 ppm
Sep 24 17:37:03 dist-test-slave-gcz9 krb5kdc[21811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271423, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:03.239455 23277 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:37:03.239842 23277 webserver.cc:460] Webserver started at http://127.6.37.3:46853/ using document root <none> and password file <none>
I20260924 17:37:03.240026 23277 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:03.240067 23277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:03.241330 23277 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:03.241917 23292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.242090 23277 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.242198 23277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab"
format_stamp: "Formatted at 2026-09-24 17:36:21 on dist-test-slave-gcz9"
server_key: "b685887d83395c7a13a4d3a739bac25a"
server_key_iv: "66f0d570e9a2768c93a74002692b7a72"
server_key_version: "encryptionkey@0"
I20260924 17:37:03.242571 23277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:03.261224 23277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:03.263787 23277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:03.263958 23277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:03.264209 23277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:03.264542 23277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:03.264597 23277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.264637 23277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:03.264665 23277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:03.270433 23277 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:38953
I20260924 17:37:03.270483 23408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:38953 every 8 connection(s)
I20260924 17:37:03.270838 23277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:37:03.271932 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.271556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:59541)
0924 17:37:03.271711 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.271784 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
W20260924 17:37:03.272354 23409 heartbeater.cc:644] Failed to heartbeat to 127.6.37.62:38297 (0 consecutive failures): Network error: Failed to ping master at 127.6.37.62:38297: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
I20260924 17:37:03.272383 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 23277
I20260924 17:37:03.272660 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.272551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:60945)
0924 17:37:03.272606 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.272640 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260924 17:37:03.272958 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:03.272902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:49529)
0924 17:37:03.272926 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:03.272945 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260924 17:37:03.273102 23409 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260924 17:37:04.086560 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.086299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:60797)
0924 17:37:04.086449 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:04.086492 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260924 17:37:04.146469 23414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.146226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:50213)
0924 17:37:04.146371 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:04.146418 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260924 17:37:04.273679 23415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.273470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:53043)
0924 17:37:04.273602 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:04.273632 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260924 17:37:04.283113 23416 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:04.283223 23416 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:04.283537 23416 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
Sep 24 17:37:04 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271422, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.2@KRBTEST.COM
Sep 24 17:37:04 dist-test-slave-gcz9 krb5kdc[21811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271422, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.3@KRBTEST.COM
I20260924 17:37:04.294445 23413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.283651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:38953 (local address 127.6.37.1:40053)
0924 17:37:04.283705 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:04.283715 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:04.283768 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:04.284600 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:04.284603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:04.285037 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:04.285221 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:04.285227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.286348 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.286349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:04.287180 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:04.287183 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.287810 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.287812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:04.287900 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:04.288551 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:04.288559 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:04.290745 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:04.292678 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:04.292678 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:04.292679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:04.292930 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:04.293192 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:04.293193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:04.293193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:04.293361 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:04.293844 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:04.293851 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:04.294014 (+ 163us) client_negotiation.cc:769] Sending connection context
0924 17:37:04.294128 (+ 114us) client_negotiation.cc:240] Negotiation successful
0924 17:37:04.294328 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":80}
I20260924 17:37:04.294462 23418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.283760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:40053 (local address 127.6.37.3:38953)
0924 17:37:04.283872 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:04.283885 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:04.283923 (+ 38us) server_negotiation.cc:407] Connection header received
0924 17:37:04.284375 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:04.284377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:04.284417 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:04.284541 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:04.285366 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.286224 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.287270 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.287694 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.287827 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:04.290853 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:04.290864 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:04.290864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:04.290913 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:04.292593 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:04.293019 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:04.293022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:04.293022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:04.293127 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:04.293436 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:04.293437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:04.293437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:04.293762 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:04.293854 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:04.294209 (+ 355us) server_negotiation.cc:299] Negotiation successful
0924 17:37:04.294348 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":53,"threads_started":1}
I20260924 17:37:04.294480 23419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.283833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:40259 (local address 127.6.37.2:42619)
0924 17:37:04.283982 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:04.283994 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:04.284030 (+ 36us) server_negotiation.cc:407] Connection header received
0924 17:37:04.284482 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:04.284485 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:04.284559 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:04.284699 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:04.285355 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.286218 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.287267 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.287694 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.287833 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:04.290478 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:04.290482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:04.290483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:04.290495 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:04.292398 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:04.292962 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:04.292966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:04.292966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:04.293095 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:04.293437 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:04.293438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:04.293438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:04.293762 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:04.293854 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:04.294209 (+ 355us) server_negotiation.cc:299] Negotiation successful
0924 17:37:04.294348 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":54,"threads_started":1}
I20260924 17:37:04.294819 23417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:04.283733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:42619 (local address 127.6.37.1:40259)
0924 17:37:04.283849 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:04.283860 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:04.283917 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:04.284703 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:04.284704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:04.285034 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:04.285221 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:04.285226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.286322 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.286323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:04.287180 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:04.287182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:04.287790 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:04.287791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:04.287899 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:04.288623 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:04.288628 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:04.290342 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:04.292499 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:04.292507 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:04.292509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:04.292824 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:04.293192 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:04.293193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:04.293193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:04.293361 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:04.293844 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:04.293851 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:04.294009 (+ 158us) client_negotiation.cc:769] Sending connection context
0924 17:37:04.294128 (+ 119us) client_negotiation.cc:240] Negotiation successful
0924 17:37:04.294385 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":107,"thread_start_us":48,"threads_started":1}
W20260924 17:37:04.295440 23024 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
W20260924 17:37:04.295598 23023 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
I20260924 17:37:04.295668 23023 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14857379c67a4653b578843f794f98d1; no voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967
I20260924 17:37:04.295778 23416 raft_consensus.cc:2726] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:37:05.087312 23420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:05.087108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:33423)
0924 17:37:05.087234 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:05.087266 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260924 17:37:05.147127 23421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:05.146857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:36473)
0924 17:37:05.147045 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:05.147089 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":156,"threads_started":1}
I20260924 17:37:05.274284 23422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:05.274092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:38315)
0924 17:37:05.274218 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:05.274248 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260924 17:37:05.798460 23423 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:05.798556 23423 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:05.798722 23423 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
W20260924 17:37:05.799149 23024 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
W20260924 17:37:05.799240 23023 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
I20260924 17:37:05.799340 23023 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14857379c67a4653b578843f794f98d1; no voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967
I20260924 17:37:05.799415 23423 raft_consensus.cc:2726] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:37:06.088063 23424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:06.087845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:35309)
0924 17:37:06.087977 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:06.088015 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260924 17:37:06.147732 23425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:06.147533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:50943)
0924 17:37:06.147656 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:06.147692 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260924 17:37:06.274986 23426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:06.274724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:58205)
0924 17:37:06.274900 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:06.274944 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":72,"threads_started":1}
I20260924 17:37:07.088827 23427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:07.088585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:33925)
0924 17:37:07.088739 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:07.088779 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":74,"threads_started":1}
I20260924 17:37:07.148346 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:07.148152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:34309)
0924 17:37:07.148275 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:07.148309 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260924 17:37:07.275650 23429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:07.275437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:51563)
0924 17:37:07.275572 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:07.275609 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260924 17:37:08.089627 23430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:08.089371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:35773)
0924 17:37:08.089523 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:08.089575 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260924 17:37:08.149030 23431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:08.148796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:34501)
0924 17:37:08.148924 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:08.148973 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260924 17:37:08.276264 23432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:08.276065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:56199)
0924 17:37:08.276195 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:08.276226 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260924 17:37:08.378091 23433 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:08.378202 23433 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:08.378417 23433 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
W20260924 17:37:08.378775 23023 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
W20260924 17:37:08.378847 23024 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
I20260924 17:37:08.379022 23024 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14857379c67a4653b578843f794f98d1; no voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967
I20260924 17:37:08.379156 23433 raft_consensus.cc:2726] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:37:09.090395 23434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:09.090183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:55207)
0924 17:37:09.090316 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:09.090349 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":66,"threads_started":1}
I20260924 17:37:09.149673 23435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:09.149422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:51675)
0924 17:37:09.149596 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:09.149632 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":85,"threads_started":1}
I20260924 17:37:09.276960 23436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:09.276685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:37089)
0924 17:37:09.276880 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:09.276919 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":71,"threads_started":1}
I20260924 17:37:10.091269 23437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:10.091058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:44085)
0924 17:37:10.091182 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:10.091220 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260924 17:37:10.150275 23438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:10.150080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:45891)
0924 17:37:10.150197 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:10.150233 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260924 17:37:10.277577 23439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:10.277383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:59945)
0924 17:37:10.277499 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:10.277533 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260924 17:37:10.713830 23440 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:10.713971 23440 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:10.714211 23440 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
W20260924 17:37:10.714663 23023 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
W20260924 17:37:10.714745 23024 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
I20260924 17:37:10.714787 23024 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14857379c67a4653b578843f794f98d1; no voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967
I20260924 17:37:10.714859 23440 raft_consensus.cc:2726] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:37:11.091974 23441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:11.091757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:42089)
0924 17:37:11.091893 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:11.091927 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260924 17:37:11.151003 23442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:11.150725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:42321)
0924 17:37:11.150854 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:11.150935 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260924 17:37:11.278211 23443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:11.278021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:56259)
0924 17:37:11.278136 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:11.278171 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260924 17:37:12.092741 23444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:12.092500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:40125)
0924 17:37:12.092659 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:12.092694 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":97,"threads_started":1}
I20260924 17:37:12.151625 23445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:12.151436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:37023)
0924 17:37:12.151550 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:12.151584 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":61,"threads_started":1}
I20260924 17:37:12.278924 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:12.278694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:60323)
0924 17:37:12.278808 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:12.278841 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
I20260924 17:37:13.093446 23447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:13.093208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:50437)
0924 17:37:13.093352 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:13.093395 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":58,"threads_started":1}
I20260924 17:37:13.152279 23448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:13.152079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:57013)
0924 17:37:13.152198 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:13.152235 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":58,"threads_started":1}
I20260924 17:37:13.279630 23449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:13.279396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:54957)
0924 17:37:13.279547 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:13.279587 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
I20260924 17:37:14.094075 23450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:14.093872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:42199)
0924 17:37:14.093994 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:14.094029 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260924 17:37:14.152904 23451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:14.152713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:47125)
0924 17:37:14.152824 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:14.152858 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260924 17:37:14.280309 23452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:14.280100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:50953)
0924 17:37:14.280232 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:14.280266 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260924 17:37:15.094684 23453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:15.094477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:50535)
0924 17:37:15.094600 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:15.094637 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260924 17:37:15.153558 23454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:15.153340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:47849)
0924 17:37:15.153476 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:15.153515 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260924 17:37:15.280972 23455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:15.280754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:55049)
0924 17:37:15.280890 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:15.280928 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260924 17:37:16.095360 23456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:16.095131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:42867)
0924 17:37:16.095275 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:16.095312 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":63,"threads_started":1}
I20260924 17:37:16.154145 23457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:16.153946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:40325)
0924 17:37:16.154072 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:16.154103 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260924 17:37:16.281720 23458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:16.281528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:55281)
0924 17:37:16.281645 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:16.281679 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":57,"threads_started":1}
I20260924 17:37:16.691794 23459 raft_consensus.cc:482] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:16.691912 23459 raft_consensus.cc:504] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c9f7e249edb4f8f9740d1f6a28b50ab" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 38953 } } peers { permanent_uuid: "a3b605cb098744c486cc667cabc33967" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42619 } } peers { permanent_uuid: "14857379c67a4653b578843f794f98d1" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 38217 } }
I20260924 17:37:16.692129 23459 leader_election.cc:288] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953), a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619)
W20260924 17:37:16.692538 23023 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a3b605cb098744c486cc667cabc33967 (127.6.37.2:42619): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
W20260924 17:37:16.692612 23024 leader_election.cc:341] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 7c9f7e249edb4f8f9740d1f6a28b50ab (127.6.37.3:38953): Not found: Tablet not found: 24316ca8610c426b9026684b354f877f
I20260924 17:37:16.692659 23024 leader_election.cc:302] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 14857379c67a4653b578843f794f98d1; no voters: 7c9f7e249edb4f8f9740d1f6a28b50ab, a3b605cb098744c486cc667cabc33967
I20260924 17:37:16.692760 23459 raft_consensus.cc:2726] T 24316ca8610c426b9026684b354f877f P 14857379c67a4653b578843f794f98d1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260924 17:37:17.096014 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:17.095797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:48457)
0924 17:37:17.095919 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:17.095954 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260924 17:37:17.154858 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:17.154648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:56633)
0924 17:37:17.154777 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:17.154813 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260924 17:37:17.282418 23462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:17.282199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:54509)
0924 17:37:17.282335 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:17.282375 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":62,"threads_started":1}
I20260924 17:37:18.096827 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:18.096606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.1:46385)
0924 17:37:18.096744 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:18.096781 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
I20260924 17:37:18.155577 23464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:18.155378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.2:35833)
0924 17:37:18.155495 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:18.155531 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":62,"threads_started":1}
I20260924 17:37:18.276083 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 22970
I20260924 17:37:18.281394 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 23141
I20260924 17:37:18.283185 23465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:18.282940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38297 (local address 127.6.37.3:51867)
0924 17:37:18.283116 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:18.283146 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.62:38297: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":88,"threads_started":1}
I20260924 17:37:18.286127 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 23277
2026-09-24T17:37:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58444 ms)
[----------] 30 tests from SecurityITest (264470 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:18 dist-test-slave-gcz9 krb5kdc[23468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:18 dist-test-slave-gcz9 krb5kdc[23468](info): set up 2 sockets
Sep 24 17:37:18 dist-test-slave-gcz9 krb5kdc[23468](info): commencing operation
krb5kdc: starting...
W20260924 17:37:19.340583 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:19.461346 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34965
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:19.545006 23482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:19.545269 23482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:19.545308 23482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:19.546499 23482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:19.546576 23482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:19.546600 23482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:19.546630 23482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:19.546653 23482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:19.548245 23482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:19.548535 23482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:19.548763 23482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:19.553687 23488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:19.553678 23487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:19.553678 23490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:19.554131 23482 server_base.cc:1034] running on GCE node
I20260924 17:37:19.554370 23482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:19.554618 23482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:19.555751 23482 hybrid_clock.cc:648] HybridClock initialized: now 1790271439555738 us; error 27 us; skew 500 ppm
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:19.558202 23482 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:19.558585 23482 webserver.cc:460] Webserver started at http://127.6.37.62:44873/ using document root <none> and password file <none>
I20260924 17:37:19.558776 23482 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:19.558815 23482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:19.558964 23482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:19.559984 23482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "43ef3ee022de46768f37d3bf14903a6a"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "dc3a43320f6817abe38ad77e750bb933"
server_key_iv: "84aef918fb23ff58b60cf74b5425985d"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.560292 23482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "43ef3ee022de46768f37d3bf14903a6a"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "dc3a43320f6817abe38ad77e750bb933"
server_key_iv: "84aef918fb23ff58b60cf74b5425985d"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.561650 23482 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:19.562314 23497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.562482 23482 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:19.562595 23482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "43ef3ee022de46768f37d3bf14903a6a"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "dc3a43320f6817abe38ad77e750bb933"
server_key_iv: "84aef918fb23ff58b60cf74b5425985d"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.562670 23482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:19.578133 23482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:19.580263 23482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:19.580425 23482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:19.584408 23482 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34965
I20260924 17:37:19.584440 23550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34965 every 8 connection(s)
I20260924 17:37:19.584795 23482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:19.585692 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 23482
I20260924 17:37:19.585711 23551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:19.585809 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:19.586063 6292 external_mini_cluster.cc:1428] Setting key f610691825423d81c9a0fd545f219319
I20260924 17:37:19.589114 23551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: Bootstrap starting.
I20260924 17:37:19.589854 23551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:19.590149 23551 log.cc:824] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:19.590948 23551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: No bootstrap required, opened a new log
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:19.593468 23551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ef3ee022de46768f37d3bf14903a6a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34965 } }
I20260924 17:37:19.593654 23551 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:19.593693 23551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43ef3ee022de46768f37d3bf14903a6a, State: Initialized, Role: FOLLOWER
I20260924 17:37:19.593834 23551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ef3ee022de46768f37d3bf14903a6a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34965 } }
I20260924 17:37:19.593930 23551 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:19.593979 23551 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:19.594030 23551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:19.594700 23551 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ef3ee022de46768f37d3bf14903a6a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34965 } }
I20260924 17:37:19.594841 23551 leader_election.cc:302] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43ef3ee022de46768f37d3bf14903a6a; no voters:
I20260924 17:37:19.595072 23551 leader_election.cc:288] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:19.595110 23556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:19.595222 23556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [term 1 LEADER]: Becoming Leader. State: Replica: 43ef3ee022de46768f37d3bf14903a6a, State: Running, Role: LEADER
I20260924 17:37:19.595346 23551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:19.595395 23556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ef3ee022de46768f37d3bf14903a6a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34965 } }
I20260924 17:37:19.595783 23556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43ef3ee022de46768f37d3bf14903a6a. Latest consensus state: current_term: 1 leader_uuid: "43ef3ee022de46768f37d3bf14903a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ef3ee022de46768f37d3bf14903a6a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34965 } } }
I20260924 17:37:19.595796 23558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43ef3ee022de46768f37d3bf14903a6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43ef3ee022de46768f37d3bf14903a6a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34965 } } }
I20260924 17:37:19.595960 23556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:19.595971 23558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a [sys.catalog]: This master's current role is: LEADER
W20260924 17:37:19.597267 23572 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:19.597337 23572 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:19.597424 23565 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:19.597476 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:19.586593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.6.37.62:34965)
0924 17:37:19.586763 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:19.586771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:19.586796 (+ 25us) server_negotiation.cc:407] Connection header received
0924 17:37:19.587383 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:19.587391 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:19.587440 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:19.587564 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:19.588311 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.589152 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.590269 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.590681 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.590764 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:19.593359 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:19.593364 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:19.593364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:19.593374 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:19.595239 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:19.595664 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:19.595667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:19.595667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:19.595772 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:19.596004 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:19.596005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:19.596005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:19.596328 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:19.597007 (+ 679us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:19.597080 (+ 73us) server_negotiation.cc:299] Negotiation successful
0924 17:37:19.597240 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260924 17:37:19.597616 23565 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:19.599176 23565 catalog_manager.cc:1347] Generated new cluster ID: de2301e036ce464d826a609197944344
I20260924 17:37:19.599228 23565 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:19.619278 23565 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:19.619793 23565 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:19.630195 23565 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: Generated new TSK 0
I20260924 17:37:19.630394 23565 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:37:19.661646 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34965
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:19.746752 23577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:19.747007 23577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:19.747035 23577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:19.748260 23577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:19.748301 23577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:19.748327 23577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:19.749691 23577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:19.749861 23577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:19.750113 23577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:19.755081 23585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:19.755084 23582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:19.755241 23577 server_base.cc:1034] running on GCE node
W20260924 17:37:19.755317 23583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:19.755584 23577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:19.755854 23577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:19.757056 23577 hybrid_clock.cc:648] HybridClock initialized: now 1790271439757044 us; error 27 us; skew 500 ppm
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:19.759996 23577 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:37:19.760500 23577 webserver.cc:460] Webserver started at http://127.6.37.1:44409/ using document root <none> and password file <none>
I20260924 17:37:19.760812 23577 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:19.760888 23577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:19.761026 23577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:19.762116 23577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "f924388dd33f4c548a9d0e4282ef9a4f"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "99870ab457cde18d516f183712a2367e"
server_key_iv: "50d43a5d3c974bf8219ba266eeae6fe4"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.762445 23577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "f924388dd33f4c548a9d0e4282ef9a4f"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "99870ab457cde18d516f183712a2367e"
server_key_iv: "50d43a5d3c974bf8219ba266eeae6fe4"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.763861 23577 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:19.764585 23592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.764792 23577 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:19.764904 23577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "f924388dd33f4c548a9d0e4282ef9a4f"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "99870ab457cde18d516f183712a2367e"
server_key_iv: "50d43a5d3c974bf8219ba266eeae6fe4"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.764998 23577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:19.802554 23577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:19.805215 23577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:19.805400 23577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:19.805717 23577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:19.806064 23577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:19.806124 23577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.806172 23577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:19.806203 23577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.812325 23577 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:37175
I20260924 17:37:19.812402 23707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:37175 every 8 connection(s)
I20260924 17:37:19.812760 23577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:19.816843 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 23577
I20260924 17:37:19.816993 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:37:19.817225 6292 external_mini_cluster.cc:1428] Setting key b3ad209e7de7cba77b45321d38881c54
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:19.823159 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:19.813572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:54147 (local address 127.6.37.62:34965)
0924 17:37:19.813645 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:19.813647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:19.813864 (+ 217us) server_negotiation.cc:407] Connection header received
0924 17:37:19.814394 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:19.814396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:19.814409 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:19.814460 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:19.815484 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.815996 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.817031 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.817409 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.817525 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:19.820071 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:19.820072 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:19.820072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:19.820081 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:19.821545 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:19.822107 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:19.822108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:19.822108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:19.822162 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:19.822450 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:19.822450 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:19.822451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:19.822562 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:19.822610 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:19.823021 (+ 411us) server_negotiation.cc:299] Negotiation successful
0924 17:37:19.823095 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:37:19.823535 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:19.813557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34965 (local address 127.6.37.1:54147)
0924 17:37:19.813741 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:19.813777 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:19.814286 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:19.814530 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:19.814534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:19.815181 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:19.815374 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:19.815380 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.816096 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.816097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:19.816926 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:19.816929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.817533 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.817535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:19.817664 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:19.818232 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:19.818245 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:19.819949 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:19.821634 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:19.821643 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:19.821646 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:19.822025 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:19.822215 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:19.822216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:19.822217 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:19.822375 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:19.822632 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:19.822640 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:19.822833 (+ 193us) client_negotiation.cc:769] Sending connection context
0924 17:37:19.823010 (+ 177us) client_negotiation.cc:240] Negotiation successful
0924 17:37:19.823222 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
I20260924 17:37:19.824146 23708 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34965
I20260924 17:37:19.824262 23708 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:19.824445 23708 heartbeater.cc:511] Master 127.6.37.62:34965 requested a full tablet report, sending...
I20260924 17:37:19.825023 23514 ts_manager.cc:194] Registered new tserver with Master: f924388dd33f4c548a9d0e4282ef9a4f (127.6.37.1:37175)
I20260924 17:37:19.825644 23514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:54147
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:37:19.844980 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34965
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:19.925424 23713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:19.925618 23713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:19.925642 23713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:19.926807 23713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:19.926852 23713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:19.926929 23713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:19.928352 23713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:19.928588 23713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:19.928799 23713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:19.933802 23718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:19.933763 23719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:19.933779 23721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:19.934016 23713 server_base.cc:1034] running on GCE node
I20260924 17:37:19.934269 23713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:19.934515 23713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:19.935678 23713 hybrid_clock.cc:648] HybridClock initialized: now 1790271439935665 us; error 44 us; skew 500 ppm
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:19.938083 23713 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:37:19.938503 23713 webserver.cc:460] Webserver started at http://127.6.37.2:40215/ using document root <none> and password file <none>
I20260924 17:37:19.938746 23713 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:19.938812 23713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:19.938988 23713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:19.940039 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "aff9b2accf72445a9e2666783fb6a07f"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "7b614d4285afddad355731c4e7ca90f6"
server_key_iv: "5d64f434f1bf305874486e584f6b3c78"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.940392 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "aff9b2accf72445a9e2666783fb6a07f"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "7b614d4285afddad355731c4e7ca90f6"
server_key_iv: "5d64f434f1bf305874486e584f6b3c78"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.941681 23713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:37:19.942385 23728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.942550 23713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:19.942651 23713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "aff9b2accf72445a9e2666783fb6a07f"
format_stamp: "Formatted at 2026-09-24 17:37:19 on dist-test-slave-gcz9"
server_key: "7b614d4285afddad355731c4e7ca90f6"
server_key_iv: "5d64f434f1bf305874486e584f6b3c78"
server_key_version: "encryptionkey@0"
I20260924 17:37:19.942726 23713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:19.952716 23713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:19.954563 23713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:19.954717 23713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:19.955027 23713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:19.955343 23713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:19.955396 23713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.955438 23713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:19.955464 23713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:19.961316 23713 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:37303
I20260924 17:37:19.961374 23842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:37303 every 8 connection(s)
I20260924 17:37:19.961687 23713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
Sep 24 17:37:19 dist-test-slave-gcz9 krb5kdc[23468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271439, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:19.969583 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 23713
I20260924 17:37:19.969710 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:37:19.969928 6292 external_mini_cluster.cc:1428] Setting key 514b6768af85f7871f7d1beecde0badc
I20260924 17:37:19.971623 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:19.962415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:46021 (local address 127.6.37.62:34965)
0924 17:37:19.962484 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:19.962486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:19.962710 (+ 224us) server_negotiation.cc:407] Connection header received
0924 17:37:19.963255 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:19.963257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:19.963268 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:19.963324 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:19.964218 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.964751 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.965754 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.965991 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.966049 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:19.968396 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:19.968397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:19.968397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:19.968404 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:19.970098 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:19.970588 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:19.970589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:19.970590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:19.970661 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:19.970987 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:19.970988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:19.970988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:19.971094 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:19.971149 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:19.971493 (+ 344us) server_negotiation.cc:299] Negotiation successful
0924 17:37:19.971560 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260924 17:37:19.971920 23845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:19.962416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34965 (local address 127.6.37.2:46021)
0924 17:37:19.962565 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:19.962600 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:19.963158 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:19.963409 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:19.963412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:19.963953 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:19.964139 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:19.964143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.964823 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.964823 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:19.965650 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:19.965652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:19.966066 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:19.966067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:19.966173 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:19.966657 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:19.966665 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:19.968271 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:19.970219 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:19.970228 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:19.970230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:19.970509 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:19.970738 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:19.970739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:19.970740 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:19.970919 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:19.971161 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:19.971169 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:19.971342 (+ 173us) client_negotiation.cc:769] Sending connection context
0924 17:37:19.971459 (+ 117us) client_negotiation.cc:240] Negotiation successful
0924 17:37:19.971638 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":87,"threads_started":1}
I20260924 17:37:19.972472 23843 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34965
I20260924 17:37:19.972580 23843 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:19.972774 23843 heartbeater.cc:511] Master 127.6.37.62:34965 requested a full tablet report, sending...
I20260924 17:37:19.973148 23514 ts_manager.cc:194] Registered new tserver with Master: aff9b2accf72445a9e2666783fb6a07f (127.6.37.2:37303)
I20260924 17:37:19.973562 23514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:46021
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:37:19.995440 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34965
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:20.076259 23848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:20.076505 23848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:20.076546 23848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:20.077737 23848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:20.077805 23848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:20.077852 23848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:20.079368 23848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:20.079643 23848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:20.079877 23848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:20.084811 23857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.084934 23855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.084854 23854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:20.085064 23848 server_base.cc:1034] running on GCE node
I20260924 17:37:20.085273 23848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:20.085521 23848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:20.086681 23848 hybrid_clock.cc:648] HybridClock initialized: now 1790271440086681 us; error 56 us; skew 500 ppm
Sep 24 17:37:20 dist-test-slave-gcz9 krb5kdc[23468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271440, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:20.089133 23848 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:37:20.089615 23848 webserver.cc:460] Webserver started at http://127.6.37.3:34077/ using document root <none> and password file <none>
I20260924 17:37:20.089851 23848 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:20.089919 23848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:20.090054 23848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:20.091150 23848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "6b09046668884602810dcb3a8db5d083"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "e961c23c8dfc5feee96d95ee09533ad9"
server_key_iv: "c14d64b71acfd6c51a1eed093363cfe5"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.091513 23848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "6b09046668884602810dcb3a8db5d083"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "e961c23c8dfc5feee96d95ee09533ad9"
server_key_iv: "c14d64b71acfd6c51a1eed093363cfe5"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.092841 23848 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:20.093590 23864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.093771 23848 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:20.093868 23848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "6b09046668884602810dcb3a8db5d083"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "e961c23c8dfc5feee96d95ee09533ad9"
server_key_iv: "c14d64b71acfd6c51a1eed093363cfe5"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.093948 23848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:20.127406 23848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:20.129552 23848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:20.129736 23848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:20.130055 23848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:20.130532 23848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:20.130594 23848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.130630 23848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:20.130661 23848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.136833 23848 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:45751
I20260924 17:37:20.136869 23977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:45751 every 8 connection(s)
I20260924 17:37:20.137233 23848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:37:20.140460 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 23848
I20260924 17:37:20.140576 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:37:20.140746 6292 external_mini_cluster.cc:1428] Setting key c34be816a7d675c4c347bfc4237910f3
Sep 24 17:37:20 dist-test-slave-gcz9 krb5kdc[23468](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271440, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:20.147228 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.138106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:33009 (local address 127.6.37.62:34965)
0924 17:37:20.138187 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.138190 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.138297 (+ 107us) server_negotiation.cc:407] Connection header received
0924 17:37:20.138847 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.138848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.138861 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.138956 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.139916 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.140438 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.141797 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.142027 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.142106 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.144328 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.144329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.144330 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:20.144337 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.145814 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:20.146261 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:20.146262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:20.146263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:20.146327 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:20.146621 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:20.146622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:20.146622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:20.146729 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.146780 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.147087 (+ 307us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.147162 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260924 17:37:20.147485 23980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.138002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34965 (local address 127.6.37.3:33009)
0924 17:37:20.138176 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.138229 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.138710 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.139050 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.139054 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.139628 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:20.139827 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.139832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.140545 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.140546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.141699 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.141703 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.142115 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.142116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.142253 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.142795 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:20.142805 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:20.144223 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:20.145939 (+ 1716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:20.145946 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:20.145949 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:20.146170 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:20.146440 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:20.146441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:20.146441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:20.146557 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:20.146788 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:20.146793 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:20.146969 (+ 176us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.147060 (+ 91us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.147188 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260924 17:37:20.148077 23978 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34965
I20260924 17:37:20.148290 23978 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:20.148481 23978 heartbeater.cc:511] Master 127.6.37.62:34965 requested a full tablet report, sending...
I20260924 17:37:20.148912 23514 ts_manager.cc:194] Registered new tserver with Master: 6b09046668884602810dcb3a8db5d083 (127.6.37.3:45751)
I20260924 17:37:20.149283 23514 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:33009
I20260924 17:37:20.152328 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:37:20.159937 23554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.153720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51256 (local address 127.6.37.62:34965)
0924 17:37:20.153803 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.153806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.153892 (+ 86us) server_negotiation.cc:407] Connection header received
0924 17:37:20.153969 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.153971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.153980 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.154030 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.154582 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.155149 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.155905 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.156111 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.156185 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.157355 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.157356 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.157357 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:20.157364 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.158651 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:20.159079 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:20.159080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:20.159080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:20.159144 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:20.159352 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:20.159353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:20.159353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:20.159519 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.159630 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.159740 (+ 110us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.159822 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260924 17:37:20.161862 23514 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51256:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:37:20.163620 23514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:37:20.170610 23990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.166158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37303 (local address 127.0.0.1:51338)
0924 17:37:20.166334 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.166376 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.166441 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.166759 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.166763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.166765 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.166982 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.166986 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.168067 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.168068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.169405 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.169407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.170290 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.170291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.170380 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.170395 (+ 15us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.170471 (+ 76us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.170533 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":51,"threads_started":1}
I20260924 17:37:20.170686 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.166374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51338 (local address 127.6.37.2:37303)
0924 17:37:20.166535 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.166542 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.166559 (+ 17us) server_negotiation.cc:407] Connection header received
0924 17:37:20.166625 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.166627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.166643 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.166739 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.167077 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.167955 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.169488 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.170197 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.170275 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.170336 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.170513 (+ 177us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.170566 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260924 17:37:20.170801 23989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.166158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:37175 (local address 127.0.0.1:49366)
0924 17:37:20.166508 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.166516 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.166568 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.167106 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.167107 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.167109 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.167163 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.167165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.168604 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.168606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.169643 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.169645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.170555 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.170556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.170624 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.170628 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.170672 (+ 44us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.170720 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":5,"thread_start_us":80,"threads_started":1}
I20260924 17:37:20.171155 23991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.166273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.6.37.1:37175)
0924 17:37:20.166907 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.166913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.166923 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:37:20.166970 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.166972 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.166989 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.167243 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.167326 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.168484 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.169723 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.170435 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.170870 (+ 435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.170975 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.171021 (+ 46us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.171071 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":94,"threads_started":1}
I20260924 17:37:20.171700 23993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.166380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:45751 (local address 127.0.0.1:53644)
0924 17:37:20.166856 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.166884 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.166940 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.167209 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.167210 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.167212 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.167243 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.167244 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.169713 (+ 2469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.169713 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.170487 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.170489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.171478 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.171479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.171541 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.171546 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.171599 (+ 53us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.171638 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":79,"threads_started":1}
I20260924 17:37:20.171754 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.166646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53644 (local address 127.6.37.3:45751)
0924 17:37:20.166835 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.166840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.166999 (+ 159us) server_negotiation.cc:407] Connection header received
0924 17:37:20.167043 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.167045 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.167061 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.167128 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.167320 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.168473 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.170574 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.171389 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.171457 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.171516 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.171630 (+ 114us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.171671 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
I20260924 17:37:20.171761 23776 tablet_service.cc:1467] Processing CreateTablet for tablet 46e52ba8ef084f188c3e2939daafeeee (DEFAULT_TABLE table=test-table [id=1e6ef6b8bc73432ea05c87c491b4a7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:20.171782 23641 tablet_service.cc:1467] Processing CreateTablet for tablet 46e52ba8ef084f188c3e2939daafeeee (DEFAULT_TABLE table=test-table [id=1e6ef6b8bc73432ea05c87c491b4a7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:20.172088 23641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e52ba8ef084f188c3e2939daafeeee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.172088 23776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e52ba8ef084f188c3e2939daafeeee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.174501 23995 tablet_bootstrap.cc:492] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: Bootstrap starting.
I20260924 17:37:20.174599 23996 tablet_bootstrap.cc:492] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Bootstrap starting.
I20260924 17:37:20.175294 23996 tablet_bootstrap.cc:654] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.175267 23912 tablet_service.cc:1467] Processing CreateTablet for tablet 46e52ba8ef084f188c3e2939daafeeee (DEFAULT_TABLE table=test-table [id=1e6ef6b8bc73432ea05c87c491b4a7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:20.175699 23912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46e52ba8ef084f188c3e2939daafeeee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.175868 23996 log.cc:824] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.176607 23996 tablet_bootstrap.cc:492] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: No bootstrap required, opened a new log
I20260924 17:37:20.176687 23996 ts_tablet_manager.cc:1397] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:37:20.178269 23996 raft_consensus.cc:348] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.178426 23996 raft_consensus.cc:374] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.178472 23996 raft_consensus.cc:729] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff9b2accf72445a9e2666783fb6a07f, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.178586 23996 consensus_queue.cc:260] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.178696 23998 tablet_bootstrap.cc:492] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Bootstrap starting.
I20260924 17:37:20.178877 23996 ts_tablet_manager.cc:1428] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:37:20.179042 23843 heartbeater.cc:503] Master 127.6.37.62:34965 was elected leader, sending a full tablet report...
I20260924 17:37:20.179175 23995 tablet_bootstrap.cc:654] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.179504 23998 tablet_bootstrap.cc:654] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.179847 23995 log.cc:824] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.180127 23998 log.cc:824] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.180632 23995 tablet_bootstrap.cc:492] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: No bootstrap required, opened a new log
I20260924 17:37:20.180688 23995 ts_tablet_manager.cc:1397] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260924 17:37:20.180895 23998 tablet_bootstrap.cc:492] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: No bootstrap required, opened a new log
I20260924 17:37:20.181002 23998 ts_tablet_manager.cc:1397] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:20.182235 23995 raft_consensus.cc:348] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.182392 23995 raft_consensus.cc:374] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.182439 23995 raft_consensus.cc:729] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f924388dd33f4c548a9d0e4282ef9a4f, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.182564 23995 consensus_queue.cc:260] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.182503 23998 raft_consensus.cc:348] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.182721 23998 raft_consensus.cc:374] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.182771 23998 raft_consensus.cc:729] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b09046668884602810dcb3a8db5d083, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.182838 23995 ts_tablet_manager.cc:1428] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:20.182919 23998 consensus_queue.cc:260] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.182981 23708 heartbeater.cc:503] Master 127.6.37.62:34965 was elected leader, sending a full tablet report...
I20260924 17:37:20.183228 23998 ts_tablet_manager.cc:1428] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 17:37:20.183261 23978 heartbeater.cc:503] Master 127.6.37.62:34965 was elected leader, sending a full tablet report...
W20260924 17:37:20.212248 23844 tablet.cc:2369] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:20.286194 24002 raft_consensus.cc:482] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:20.286360 24002 raft_consensus.cc:504] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.286777 24002 leader_election.cc:288] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff9b2accf72445a9e2666783fb6a07f (127.6.37.2:37303), 6b09046668884602810dcb3a8db5d083 (127.6.37.3:45751)
I20260924 17:37:20.290481 23994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.287094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:37487 (local address 127.6.37.3:45751)
0924 17:37:20.287148 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.287150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.287164 (+ 14us) server_negotiation.cc:407] Connection header received
0924 17:37:20.287197 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.287198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.287212 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.287338 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.287567 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.288246 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.289738 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.290103 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.290157 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.290166 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.290356 (+ 190us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.290390 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260924 17:37:20.290506 23710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.286989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:45751 (local address 127.6.37.1:37487)
0924 17:37:20.287063 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.287075 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.287119 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.287392 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.287394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.287396 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.287475 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.287477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.288343 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.288344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.289637 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.289640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.290183 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.290184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.290272 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.290277 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.290345 (+ 68us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.290403 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":9}
I20260924 17:37:20.290752 24004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.286989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37303 (local address 127.6.37.1:49919)
0924 17:37:20.287127 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.287136 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.287176 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.287342 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.287343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.287345 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.287422 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.287424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.288195 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.288197 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.289637 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.289640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.290472 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.290473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.290556 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.290562 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.290616 (+ 54us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.290670 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260924 17:37:20.290807 23992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.287102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:49919 (local address 127.6.37.2:37303)
0924 17:37:20.287157 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.287160 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.287170 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:37:20.287232 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.287233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.287245 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.287311 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.287499 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.288098 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.289773 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.290384 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.290455 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.290466 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.290666 (+ 200us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.290721 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:37:20.291133 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e52ba8ef084f188c3e2939daafeeee" candidate_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b09046668884602810dcb3a8db5d083" is_pre_election: true
I20260924 17:37:20.291353 23932 raft_consensus.cc:2454] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f924388dd33f4c548a9d0e4282ef9a4f in term 0.
I20260924 17:37:20.291421 23796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e52ba8ef084f188c3e2939daafeeee" candidate_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff9b2accf72445a9e2666783fb6a07f" is_pre_election: true
I20260924 17:37:20.291586 23796 raft_consensus.cc:2454] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f924388dd33f4c548a9d0e4282ef9a4f in term 0.
I20260924 17:37:20.291659 23593 leader_election.cc:302] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b09046668884602810dcb3a8db5d083, f924388dd33f4c548a9d0e4282ef9a4f; no voters:
I20260924 17:37:20.291857 24002 raft_consensus.cc:2781] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:37:20.291937 24002 raft_consensus.cc:482] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:37:20.291980 24002 raft_consensus.cc:3037] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.292821 24002 raft_consensus.cc:504] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.292994 24002 leader_election.cc:288] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [CANDIDATE]: Term 1 election: Requested vote from peers aff9b2accf72445a9e2666783fb6a07f (127.6.37.2:37303), 6b09046668884602810dcb3a8db5d083 (127.6.37.3:45751)
I20260924 17:37:20.293136 23796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e52ba8ef084f188c3e2939daafeeee" candidate_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff9b2accf72445a9e2666783fb6a07f"
I20260924 17:37:20.293191 23932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e52ba8ef084f188c3e2939daafeeee" candidate_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b09046668884602810dcb3a8db5d083"
I20260924 17:37:20.293218 23796 raft_consensus.cc:3037] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.293291 23932 raft_consensus.cc:3037] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.293941 23796 raft_consensus.cc:2454] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f924388dd33f4c548a9d0e4282ef9a4f in term 1.
I20260924 17:37:20.294121 23594 leader_election.cc:302] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aff9b2accf72445a9e2666783fb6a07f, f924388dd33f4c548a9d0e4282ef9a4f; no voters:
I20260924 17:37:20.294171 23932 raft_consensus.cc:2454] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f924388dd33f4c548a9d0e4282ef9a4f in term 1.
I20260924 17:37:20.294240 24002 raft_consensus.cc:2781] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:20.294467 24002 raft_consensus.cc:686] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 1 LEADER]: Becoming Leader. State: Replica: f924388dd33f4c548a9d0e4282ef9a4f, State: Running, Role: LEADER
I20260924 17:37:20.294562 24002 consensus_queue.cc:237] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } }
I20260924 17:37:20.295619 23514 catalog_manager.cc:5495] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f reported cstate change: term changed from 0 to 1, leader changed from <none> to f924388dd33f4c548a9d0e4282ef9a4f (127.6.37.1). New cstate: current_term: 1 leader_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f924388dd33f4c548a9d0e4282ef9a4f" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 37175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 } health_report { overall_health: UNKNOWN } } }
W20260924 17:37:20.313581 23709 tablet.cc:2369] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:20.317900 23991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.315442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49368 (local address 127.6.37.1:37175)
0924 17:37:20.315491 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.315493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.315503 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:37:20.315579 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.315580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.315610 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.315687 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:20.315815 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.316298 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.317098 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.317301 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.317387 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.317564 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:20.317672 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:20.317769 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.317795 (+ 26us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.317817 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:37:20.319774 23796 raft_consensus.cc:1261] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 1 FOLLOWER]: Refusing update from remote peer f924388dd33f4c548a9d0e4282ef9a4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:20.319828 23932 raft_consensus.cc:1261] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 1 FOLLOWER]: Refusing update from remote peer f924388dd33f4c548a9d0e4282ef9a4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:20.320137 24002 consensus_queue.cc:1035] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aff9b2accf72445a9e2666783fb6a07f" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:20.320326 24005 consensus_queue.cc:1035] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b09046668884602810dcb3a8db5d083" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 45751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:20.322489 24008 mvcc.cc:205] Tried to move back new op lower bound from 7332951819546906624 to 7332951819447459840. Current Snapshot: MvccSnapshot[applied={T|T < 7332951819546906624}]
I20260924 17:37:20.323001 24011 mvcc.cc:205] Tried to move back new op lower bound from 7332951819546906624 to 7332951819447459840. Current Snapshot: MvccSnapshot[applied={T|T < 7332951819546906624}]
I20260924 17:37:20.324925 23513 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:20.325028 23513 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51256:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:20.325824 23513 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 43ef3ee022de46768f37d3bf14903a6a: Sending DeleteTablet for 3 replicas of tablet 46e52ba8ef084f188c3e2939daafeeee
I20260924 17:37:20.326170 23641 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e52ba8ef084f188c3e2939daafeeee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:20 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:49366
I20260924 17:37:20.326198 23912 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e52ba8ef084f188c3e2939daafeeee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:20 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:53644
I20260924 17:37:20.326200 23776 tablet_service.cc:1514] Processing DeleteTablet for tablet 46e52ba8ef084f188c3e2939daafeeee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:20 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:51338
I20260924 17:37:20.326381 24019 tablet_replica.cc:330] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f: stopping tablet replica
I20260924 17:37:20.326489 24019 raft_consensus.cc:2229] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:37:20.326609 24019 raft_consensus.cc:2258] T 46e52ba8ef084f188c3e2939daafeeee P f924388dd33f4c548a9d0e4282ef9a4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:20.326622 24020 tablet_replica.cc:330] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: stopping tablet replica
I20260924 17:37:20.326632 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 23577
I20260924 17:37:20.327548 24020 raft_consensus.cc:2229] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:20.327668 24020 raft_consensus.cc:2258] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:20.326510 24021 tablet_replica.cc:330] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: stopping tablet replica
I20260924 17:37:20.327828 24021 raft_consensus.cc:2229] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:20.327929 24021 raft_consensus.cc:2258] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:20.328411 24021 ts_tablet_manager.cc:1905] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:20.329066 24020 ts_tablet_manager.cc:1905] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:20.330183 24021 ts_tablet_manager.cc:1918] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:20.330257 24021 log.cc:1196] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/46e52ba8ef084f188c3e2939daafeeee
I20260924 17:37:20.330559 24021 ts_tablet_manager.cc:1939] T 46e52ba8ef084f188c3e2939daafeeee P 6b09046668884602810dcb3a8db5d083: Deleting consensus metadata
I20260924 17:37:20.330744 24020 ts_tablet_manager.cc:1918] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:20.330817 24020 log.cc:1196] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/46e52ba8ef084f188c3e2939daafeeee
I20260924 17:37:20.331121 24020 ts_tablet_manager.cc:1939] T 46e52ba8ef084f188c3e2939daafeeee P aff9b2accf72445a9e2666783fb6a07f: Deleting consensus metadata
I20260924 17:37:20.331113 23498 catalog_manager.cc:4841] TS 6b09046668884602810dcb3a8db5d083 (127.6.37.3:45751): tablet 46e52ba8ef084f188c3e2939daafeeee (table test-table [id=1e6ef6b8bc73432ea05c87c491b4a7ab]) successfully deleted
I20260924 17:37:20.331674 23499 catalog_manager.cc:4841] TS aff9b2accf72445a9e2666783fb6a07f (127.6.37.2:37303): tablet 46e52ba8ef084f188c3e2939daafeeee (table test-table [id=1e6ef6b8bc73432ea05c87c491b4a7ab]) successfully deleted
W20260924 17:37:20.332719 23498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:37175 (error 108)
I20260924 17:37:20.332902 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 23713
I20260924 17:37:20.333670 23990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.333548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:37175 (local address 127.0.0.1:49376)
0924 17:37:20.333607 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.333643 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260924 17:37:20.333819 23498 catalog_manager.cc:4584] TS f924388dd33f4c548a9d0e4282ef9a4f (127.6.37.1:37175): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 46e52ba8ef084f188c3e2939daafeeee: Network error: Client connection negotiation failed: client connection to 127.6.37.1:37175: connect: Connection refused (error 111)
I20260924 17:37:20.338580 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 23848
I20260924 17:37:20.343428 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 23482
2026-09-24T17:37:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2057 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-24T17:37:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:20Z Disabled control of system clock
I20260924 17:37:20.370826 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34557
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:42983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:20.455876 24026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:20.456099 24026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:20.456118 24026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:20.457302 24026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:20.457345 24026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:20.457357 24026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:20.457370 24026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:20.457382 24026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:20.458670 24026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34557
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:20.458865 24026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:20.459213 24026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:20.463961 24032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.463991 24034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.464066 24031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:20.464362 24026 server_base.cc:1034] running on GCE node
I20260924 17:37:20.464629 24026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:20.464926 24026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:20.466066 24026 hybrid_clock.cc:648] HybridClock initialized: now 1790271440466050 us; error 28 us; skew 500 ppm
I20260924 17:37:20.467442 24026 webserver.cc:460] Webserver started at http://127.6.37.62:35809/ using document root <none> and password file <none>
I20260924 17:37:20.467700 24026 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:20.467748 24026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:20.467913 24026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:20.469020 24026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "03f208357db44bf688ccc8752c4d14d3"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "f11fb0be77da8b3a59f3f80d4557bea8"
server_key_iv: "1b78105a5e53999313e4b4d19d0114be"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.469395 24026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "03f208357db44bf688ccc8752c4d14d3"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "f11fb0be77da8b3a59f3f80d4557bea8"
server_key_iv: "1b78105a5e53999313e4b4d19d0114be"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.470721 24026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:37:20.471479 24041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.471670 24026 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.471762 24026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "03f208357db44bf688ccc8752c4d14d3"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "f11fb0be77da8b3a59f3f80d4557bea8"
server_key_iv: "1b78105a5e53999313e4b4d19d0114be"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.471832 24026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:20.505420 24026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:20.505812 24026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:20.505986 24026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:20.510167 24026 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34557
I20260924 17:37:20.510226 24093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34557 every 8 connection(s)
I20260924 17:37:20.510571 24026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:20.511593 24094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.514518 24094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3: Bootstrap starting.
I20260924 17:37:20.515249 24094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.515610 24094 log.cc:824] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.516388 24094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3: No bootstrap required, opened a new log
I20260924 17:37:20.517379 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24026
I20260924 17:37:20.517474 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:20.517630 6292 external_mini_cluster.cc:1428] Setting key db359a945df0a11073d9d2276f7d9482
I20260924 17:37:20.518291 24094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f208357db44bf688ccc8752c4d14d3" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34557 } }
I20260924 17:37:20.518481 24094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.518530 24094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03f208357db44bf688ccc8752c4d14d3, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.518659 24094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f208357db44bf688ccc8752c4d14d3" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34557 } }
I20260924 17:37:20.518738 24094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:20.518770 24094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:20.518818 24094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.519374 24094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f208357db44bf688ccc8752c4d14d3" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34557 } }
I20260924 17:37:20.519461 24094 leader_election.cc:302] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03f208357db44bf688ccc8752c4d14d3; no voters:
I20260924 17:37:20.519644 24094 leader_election.cc:288] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:20.519697 24099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:20.519835 24099 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [term 1 LEADER]: Becoming Leader. State: Replica: 03f208357db44bf688ccc8752c4d14d3, State: Running, Role: LEADER
I20260924 17:37:20.519920 24094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:20.519925 24099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f208357db44bf688ccc8752c4d14d3" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34557 } }
I20260924 17:37:20.520293 24099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03f208357db44bf688ccc8752c4d14d3. Latest consensus state: current_term: 1 leader_uuid: "03f208357db44bf688ccc8752c4d14d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f208357db44bf688ccc8752c4d14d3" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34557 } } }
I20260924 17:37:20.520359 24099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:20.520494 24101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03f208357db44bf688ccc8752c4d14d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03f208357db44bf688ccc8752c4d14d3" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34557 } } }
I20260924 17:37:20.520543 24101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:20.520639 24105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:20.521133 24105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:20.522779 24105 catalog_manager.cc:1347] Generated new cluster ID: 9deb609f0f3943189961fca7cdacd139
I20260924 17:37:20.522840 24105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:20.524019 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.518161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.6.37.62:34557)
0924 17:37:20.518381 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.518388 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.518416 (+ 28us) server_negotiation.cc:407] Connection header received
0924 17:37:20.518538 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.518546 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.518617 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.518763 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.518996 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.520716 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.521817 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.522400 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.522529 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.523274 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.523278 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.523278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:20.523490 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.523540 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:20.523554 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.523626 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.523705 (+ 79us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.523785 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260924 17:37:20.553568 24105 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:20.554136 24105 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:20.561059 24105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3: Generated new TSK 0
I20260924 17:37:20.561283 24105 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:20.572780 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34557
--builtin_ntp_servers=127.6.37.20:42983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:20.654264 24119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:20.654459 24119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:20.654488 24119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:20.655668 24119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:20.655709 24119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:20.655735 24119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:20.657086 24119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:20.657342 24119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:20.657649 24119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:20.662474 24124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.662480 24125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.662619 24127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:20.662771 24119 server_base.cc:1034] running on GCE node
I20260924 17:37:20.663066 24119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:20.663270 24119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:20.664408 24119 hybrid_clock.cc:648] HybridClock initialized: now 1790271440664396 us; error 26 us; skew 500 ppm
I20260924 17:37:20.665740 24119 webserver.cc:460] Webserver started at http://127.6.37.1:36197/ using document root <none> and password file <none>
I20260924 17:37:20.665951 24119 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:20.665997 24119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:20.666086 24119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:20.667186 24119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "db4615171e63417a9d1d8358c60d8b0b"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "d6dc8161111b5372cabe0660e72d55bc"
server_key_iv: "11cc7b358ea628169ce7e869df30be23"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.667491 24119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "db4615171e63417a9d1d8358c60d8b0b"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "d6dc8161111b5372cabe0660e72d55bc"
server_key_iv: "11cc7b358ea628169ce7e869df30be23"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.668684 24119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:20.669318 24133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.669487 24119 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:20.669589 24119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "db4615171e63417a9d1d8358c60d8b0b"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "d6dc8161111b5372cabe0660e72d55bc"
server_key_iv: "11cc7b358ea628169ce7e869df30be23"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.669643 24119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:20.679526 24119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:20.679756 24119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:20.679849 24119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:20.680003 24119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:20.680249 24119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:20.680277 24119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.680298 24119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:20.680310 24119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.685650 24119 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:33617
I20260924 17:37:20.685765 24248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:33617 every 8 connection(s)
I20260924 17:37:20.685992 24119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:20.687827 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24119
I20260924 17:37:20.687914 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:37:20.688120 6292 external_mini_cluster.cc:1428] Setting key fcf6ab4b3b317958e0942c4acd077f96
I20260924 17:37:20.689087 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34557
--builtin_ntp_servers=127.6.37.20:42983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 17:37:20.692132 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.686736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:53391 (local address 127.6.37.62:34557)
0924 17:37:20.686783 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.686785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.687029 (+ 244us) server_negotiation.cc:407] Connection header received
0924 17:37:20.687543 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.687545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.687556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.687614 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.688459 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.689177 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.690665 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.690930 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.691008 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.691848 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.691849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.691849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:20.691854 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.691869 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:20.691873 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.691920 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.692026 (+ 106us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.692056 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:20.692364 24251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.686688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34557 (local address 127.6.37.1:53391)
0924 17:37:20.686865 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.686924 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.687415 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.687678 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.687681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.687690 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:20.688312 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.688320 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.689287 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.689288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.690574 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.690577 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.691012 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.691013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.691147 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.691694 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:20.691694 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:20.691721 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:20.691742 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:20.691920 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:20.691925 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:20.691928 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.692026 (+ 98us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.692123 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260924 17:37:20.692822 24249 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34557
I20260924 17:37:20.692934 24249 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:20.693146 24249 heartbeater.cc:511] Master 127.6.37.62:34557 requested a full tablet report, sending...
I20260924 17:37:20.693640 24058 ts_manager.cc:194] Registered new tserver with Master: db4615171e63417a9d1d8358c60d8b0b (127.6.37.1:33617)
I20260924 17:37:20.694250 24058 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.1:53391
W20260924 17:37:20.769670 24252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:20.769878 24252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:20.769899 24252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:20.771118 24252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:20.771157 24252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:20.771209 24252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:20.772617 24252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:20.772852 24252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:20.773177 24252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:20.778111 24260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.778113 24257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.778167 24258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:20.778503 24252 server_base.cc:1034] running on GCE node
I20260924 17:37:20.778707 24252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:20.778944 24252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:20.780097 24252 hybrid_clock.cc:648] HybridClock initialized: now 1790271440780082 us; error 34 us; skew 500 ppm
I20260924 17:37:20.781417 24252 webserver.cc:460] Webserver started at http://127.6.37.2:38209/ using document root <none> and password file <none>
I20260924 17:37:20.781667 24252 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:20.781714 24252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:20.781880 24252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:20.783030 24252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "b4c8508de1e740789b191ff85c59149b"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "7644ad63be9948e576d7699ef52daab3"
server_key_iv: "6b3c9d57142b51999b81dfb5beae175f"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.783381 24252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "b4c8508de1e740789b191ff85c59149b"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "7644ad63be9948e576d7699ef52daab3"
server_key_iv: "6b3c9d57142b51999b81dfb5beae175f"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.784703 24252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:20.785378 24266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.785570 24252 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.785657 24252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "b4c8508de1e740789b191ff85c59149b"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "7644ad63be9948e576d7699ef52daab3"
server_key_iv: "6b3c9d57142b51999b81dfb5beae175f"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.785729 24252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:20.799557 24252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:20.799845 24252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:20.800005 24252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:20.800218 24252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:20.800608 24252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:20.800663 24252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.800705 24252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:20.800736 24252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.806092 24252 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:46857
I20260924 17:37:20.806170 24381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:46857 every 8 connection(s)
I20260924 17:37:20.806489 24252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:37:20.811441 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.807268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:37175 (local address 127.6.37.62:34557)
0924 17:37:20.807339 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.807340 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.807577 (+ 237us) server_negotiation.cc:407] Connection header received
0924 17:37:20.808053 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.808054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.808063 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.808124 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.808760 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.809249 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.810181 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.810363 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.810412 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.811208 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.811210 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.811210 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:20.811214 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.811230 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:20.811234 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.811276 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.811356 (+ 80us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.811382 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260924 17:37:20.811651 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.807237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34557 (local address 127.6.37.2:37175)
0924 17:37:20.807446 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.807486 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.807959 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.808201 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.808205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.808212 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:20.808691 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.808695 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.809329 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.809329 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.810109 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.810111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.810436 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.810436 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.810547 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.811076 (+ 529us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:20.811076 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:20.811104 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:20.811126 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:20.811288 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:20.811293 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:20.811295 (+ 2us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.811344 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.811423 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260924 17:37:20.812181 24382 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34557
I20260924 17:37:20.812258 24382 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:20.812441 24382 heartbeater.cc:511] Master 127.6.37.62:34557 requested a full tablet report, sending...
I20260924 17:37:20.812831 24058 ts_manager.cc:194] Registered new tserver with Master: b4c8508de1e740789b191ff85c59149b (127.6.37.2:46857)
I20260924 17:37:20.813163 24058 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.2:37175
I20260924 17:37:20.814175 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24252
I20260924 17:37:20.814255 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:37:20.814417 6292 external_mini_cluster.cc:1428] Setting key 5c6e874994b362cf5cfd43b4df078099
I20260924 17:37:20.815316 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34557
--builtin_ntp_servers=127.6.37.20:42983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:20.895859 24385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:20.896060 24385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:20.896082 24385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:20.897138 24385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:20.897169 24385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:20.897193 24385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:20.898435 24385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:42983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:20.898615 24385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:20.898846 24385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:20.903901 24391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:20.903926 24393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:20.903959 24385 server_base.cc:1034] running on GCE node
W20260924 17:37:20.903926 24390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:20.904346 24385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:20.904552 24385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:20.905692 24385 hybrid_clock.cc:648] HybridClock initialized: now 1790271440905675 us; error 31 us; skew 500 ppm
I20260924 17:37:20.906941 24385 webserver.cc:460] Webserver started at http://127.6.37.3:33777/ using document root <none> and password file <none>
I20260924 17:37:20.907192 24385 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:20.907238 24385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:20.907385 24385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:20.908438 24385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "64e3086842614a898ae02a5710bbb252"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "85533875439b691d4604fa063f0912f2"
server_key_iv: "b187b292d8b0c5f5f91d0ded564a80ef"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.908797 24385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "64e3086842614a898ae02a5710bbb252"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "85533875439b691d4604fa063f0912f2"
server_key_iv: "b187b292d8b0c5f5f91d0ded564a80ef"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.910141 24385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:20.910820 24399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.910997 24385 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:20.911098 24385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "64e3086842614a898ae02a5710bbb252"
format_stamp: "Formatted at 2026-09-24 17:37:20 on dist-test-slave-gcz9"
server_key: "85533875439b691d4604fa063f0912f2"
server_key_iv: "b187b292d8b0c5f5f91d0ded564a80ef"
server_key_version: "encryptionkey@0"
I20260924 17:37:20.911181 24385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:20.923861 24385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:20.924171 24385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:20.924326 24385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:20.924557 24385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:20.924899 24385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:20.924957 24385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.925009 24385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:20.925041 24385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:20.930938 24385 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:39439
I20260924 17:37:20.930990 24513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:39439 every 8 connection(s)
I20260924 17:37:20.931348 24385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:37:20.936460 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.932124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:53793 (local address 127.6.37.62:34557)
0924 17:37:20.932217 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.932219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.932435 (+ 216us) server_negotiation.cc:407] Connection header received
0924 17:37:20.932909 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.932911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.932922 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.932973 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.933626 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.934131 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.935166 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.935351 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.935406 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.936166 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.936167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.936167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:20.936172 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.936187 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:20.936191 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.936235 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.936320 (+ 85us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.936349 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260924 17:37:20.936578 24516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.932092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34557 (local address 127.6.37.3:53793)
0924 17:37:20.932306 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.932341 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.932822 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.933047 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.933050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.933059 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:20.933551 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.933555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.934215 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.934216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.935089 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.935092 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.935427 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.935428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.935536 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.936029 (+ 493us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:20.936029 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:20.936058 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:20.936080 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:20.936248 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:20.936252 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:20.936255 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.936307 (+ 52us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.936388 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":106,"threads_started":1}
I20260924 17:37:20.937060 24514 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34557
I20260924 17:37:20.937172 24514 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:20.937362 24514 heartbeater.cc:511] Master 127.6.37.62:34557 requested a full tablet report, sending...
I20260924 17:37:20.937760 24058 ts_manager.cc:194] Registered new tserver with Master: 64e3086842614a898ae02a5710bbb252 (127.6.37.3:39439)
I20260924 17:37:20.938244 24058 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.3:53793
I20260924 17:37:20.940120 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24385
I20260924 17:37:20.940224 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:37:20.940445 6292 external_mini_cluster.cc:1428] Setting key af79125f69b143376c2ed02c152338d8
I20260924 17:37:20.941359 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:37:20.945552 24098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.942674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53286 (local address 127.6.37.62:34557)
0924 17:37:20.942717 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.942719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.942838 (+ 119us) server_negotiation.cc:407] Connection header received
0924 17:37:20.942942 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.942943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.942955 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.943032 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:20.943213 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.943686 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.944446 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.944640 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.944715 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.945314 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:20.945316 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:20.945316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:20.945321 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:20.945335 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:20.945339 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:20.945392 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.945444 (+ 52us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.945470 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260924 17:37:20.947275 24058 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53286:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:37:20.948843 24058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:37:20.955168 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.951074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:33617 (local address 127.0.0.1:55746)
0924 17:37:20.951538 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.951581 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.951642 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.951830 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.951833 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.951835 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.951903 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.951905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.952884 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.952885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.953919 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.953922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.954837 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.954838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.954936 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.954951 (+ 15us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.955038 (+ 87us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.955093 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":61,"threads_started":1}
I20260924 17:37:20.955185 24525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.951161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55746 (local address 127.6.37.1:33617)
0924 17:37:20.951342 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.951347 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.951637 (+ 290us) server_negotiation.cc:407] Connection header received
0924 17:37:20.951707 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.951709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.951723 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.951811 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.951989 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.952787 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.954022 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.954755 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.954838 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.954963 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.955054 (+ 91us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.955098 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":107,"threads_started":1}
I20260924 17:37:20.955727 24523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.951094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:46857 (local address 127.0.0.1:45542)
0924 17:37:20.951724 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.951731 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.951796 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.952111 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.952112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.952115 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.952159 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.952161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.953449 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.953450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.954536 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.954539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.955482 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.955483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.955559 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.955565 (+ 6us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.955624 (+ 59us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.955663 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"mutex_wait_us":24,"thread_start_us":106,"threads_started":1}
I20260924 17:37:20.955777 24527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.951342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45542 (local address 127.6.37.2:46857)
0924 17:37:20.951533 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.951536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.951913 (+ 377us) server_negotiation.cc:407] Connection header received
0924 17:37:20.951963 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.951966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.951983 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.952056 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.952281 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.953359 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.954623 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.955383 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.955456 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.955545 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.955636 (+ 91us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.955681 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260924 17:37:20.956004 24182 tablet_service.cc:1467] Processing CreateTablet for tablet a0f878e95a6c46acb4d317546be915b4 (DEFAULT_TABLE table=test-table [id=7b6d79e6feef4e35a598e98d3b83d244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:20.956406 24182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0f878e95a6c46acb4d317546be915b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.956475 24522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.951094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:39439 (local address 127.0.0.1:51640)
0924 17:37:20.951871 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.951880 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.951921 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.952124 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.952125 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.952127 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.952166 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.952168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.953461 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.953463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.954359 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.954379 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.955751 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.955753 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.956284 (+ 531us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.956289 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.956344 (+ 55us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.956389 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"mutex_wait_us":23,"thread_start_us":105,"threads_started":1}
I20260924 17:37:20.956538 24314 tablet_service.cc:1467] Processing CreateTablet for tablet a0f878e95a6c46acb4d317546be915b4 (DEFAULT_TABLE table=test-table [id=7b6d79e6feef4e35a598e98d3b83d244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:20.956766 24526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.951312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51640 (local address 127.6.37.3:39439)
0924 17:37:20.951490 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.951494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.951987 (+ 493us) server_negotiation.cc:407] Connection header received
0924 17:37:20.952028 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.952031 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.952046 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.952114 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.952229 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.953357 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.954481 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.955574 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.955637 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.955716 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.956633 (+ 917us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.956678 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
I20260924 17:37:20.956875 24314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0f878e95a6c46acb4d317546be915b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.957307 24447 tablet_service.cc:1467] Processing CreateTablet for tablet a0f878e95a6c46acb4d317546be915b4 (DEFAULT_TABLE table=test-table [id=7b6d79e6feef4e35a598e98d3b83d244]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:20.957615 24447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0f878e95a6c46acb4d317546be915b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:20.959964 24528 tablet_bootstrap.cc:492] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: Bootstrap starting.
I20260924 17:37:20.960245 24529 tablet_bootstrap.cc:492] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Bootstrap starting.
I20260924 17:37:20.960605 24530 tablet_bootstrap.cc:492] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Bootstrap starting.
I20260924 17:37:20.960865 24529 tablet_bootstrap.cc:654] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.960964 24528 tablet_bootstrap.cc:654] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.961179 24529 log.cc:824] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.961287 24530 tablet_bootstrap.cc:654] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:20.961295 24528 log.cc:824] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.961599 24530 log.cc:824] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:20.962034 24528 tablet_bootstrap.cc:492] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: No bootstrap required, opened a new log
I20260924 17:37:20.962110 24528 ts_tablet_manager.cc:1397] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:20.962323 24529 tablet_bootstrap.cc:492] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: No bootstrap required, opened a new log
I20260924 17:37:20.962342 24530 tablet_bootstrap.cc:492] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: No bootstrap required, opened a new log
I20260924 17:37:20.962400 24530 ts_tablet_manager.cc:1397] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:20.962406 24529 ts_tablet_manager.cc:1397] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:20.964512 24529 raft_consensus.cc:348] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.964684 24529 raft_consensus.cc:374] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.964726 24529 raft_consensus.cc:729] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4c8508de1e740789b191ff85c59149b, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.964836 24529 consensus_queue.cc:260] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.964840 24528 raft_consensus.cc:348] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.964999 24528 raft_consensus.cc:374] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.964939 24530 raft_consensus.cc:348] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.965049 24528 raft_consensus.cc:729] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db4615171e63417a9d1d8358c60d8b0b, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.965087 24530 raft_consensus.cc:374] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:20.965121 24529 ts_tablet_manager.cc:1428] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:37:20.965157 24530 raft_consensus.cc:729] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e3086842614a898ae02a5710bbb252, State: Initialized, Role: FOLLOWER
I20260924 17:37:20.965159 24528 consensus_queue.cc:260] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.965291 24530 consensus_queue.cc:260] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.965425 24528 ts_tablet_manager.cc:1428] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260924 17:37:20.965507 24249 heartbeater.cc:503] Master 127.6.37.62:34557 was elected leader, sending a full tablet report...
I20260924 17:37:20.965531 24530 ts_tablet_manager.cc:1428] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:37:20.965626 24514 heartbeater.cc:503] Master 127.6.37.62:34557 was elected leader, sending a full tablet report...
I20260924 17:37:20.965814 24382 heartbeater.cc:503] Master 127.6.37.62:34557 was elected leader, sending a full tablet report...
I20260924 17:37:20.969420 24535 raft_consensus.cc:482] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:20.969553 24535 raft_consensus.cc:504] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.969892 24535 leader_election.cc:288] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4c8508de1e740789b191ff85c59149b (127.6.37.2:46857), 64e3086842614a898ae02a5710bbb252 (127.6.37.3:39439)
I20260924 17:37:20.973637 24527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.970241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:42337 (local address 127.6.37.2:46857)
0924 17:37:20.970288 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.970290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.970298 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:20.970343 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.970344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.970352 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.970400 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.970548 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.971243 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.972700 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.973283 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.973358 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.973368 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.973534 (+ 166us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.973574 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260924 17:37:20.973637 24526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.970108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:45689 (local address 127.6.37.3:39439)
0924 17:37:20.970153 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.970156 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.970165 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:20.970240 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.970240 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.970249 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.970299 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:20.970454 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.971241 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.972700 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.973264 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.973341 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.973352 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.973534 (+ 182us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.973574 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:20.973639 24251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.970050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:39439 (local address 127.6.37.1:45689)
0924 17:37:20.970123 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.970135 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.970171 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.970316 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.970318 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.970319 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.970389 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.970391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.971322 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.971323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.972609 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.972613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.973355 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.973357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.973437 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.973442 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.973503 (+ 61us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.973548 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":51}
I20260924 17:37:20.973645 24537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.970059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:46857 (local address 127.6.37.1:42337)
0924 17:37:20.970225 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:20.970235 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:20.970286 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:20.970406 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:20.970407 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:20.970408 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:20.970484 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.970485 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.971322 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.971323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.972609 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:20.972613 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.973356 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.973357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:20.973439 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.973442 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:20.973511 (+ 69us) client_negotiation.cc:240] Negotiation successful
0924 17:37:20.973547 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":70,"thread_start_us":93,"threads_started":1}
I20260924 17:37:20.974028 24467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0f878e95a6c46acb4d317546be915b4" candidate_uuid: "db4615171e63417a9d1d8358c60d8b0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e3086842614a898ae02a5710bbb252" is_pre_election: true
I20260924 17:37:20.974094 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0f878e95a6c46acb4d317546be915b4" candidate_uuid: "db4615171e63417a9d1d8358c60d8b0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4c8508de1e740789b191ff85c59149b" is_pre_election: true
I20260924 17:37:20.974182 24467 raft_consensus.cc:2454] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db4615171e63417a9d1d8358c60d8b0b in term 0.
I20260924 17:37:20.974265 24336 raft_consensus.cc:2454] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db4615171e63417a9d1d8358c60d8b0b in term 0.
I20260924 17:37:20.974424 24136 leader_election.cc:302] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e3086842614a898ae02a5710bbb252, db4615171e63417a9d1d8358c60d8b0b; no voters:
I20260924 17:37:20.974550 24535 raft_consensus.cc:2781] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:37:20.974606 24535 raft_consensus.cc:482] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:37:20.974635 24535 raft_consensus.cc:3037] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.975494 24535 raft_consensus.cc:504] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.975638 24535 leader_election.cc:288] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [CANDIDATE]: Term 1 election: Requested vote from peers b4c8508de1e740789b191ff85c59149b (127.6.37.2:46857), 64e3086842614a898ae02a5710bbb252 (127.6.37.3:39439)
I20260924 17:37:20.975797 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0f878e95a6c46acb4d317546be915b4" candidate_uuid: "db4615171e63417a9d1d8358c60d8b0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4c8508de1e740789b191ff85c59149b"
I20260924 17:37:20.975798 24467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0f878e95a6c46acb4d317546be915b4" candidate_uuid: "db4615171e63417a9d1d8358c60d8b0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e3086842614a898ae02a5710bbb252"
I20260924 17:37:20.975872 24336 raft_consensus.cc:3037] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.975872 24467 raft_consensus.cc:3037] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:20.976747 24467 raft_consensus.cc:2454] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db4615171e63417a9d1d8358c60d8b0b in term 1.
I20260924 17:37:20.976747 24336 raft_consensus.cc:2454] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db4615171e63417a9d1d8358c60d8b0b in term 1.
I20260924 17:37:20.976940 24136 leader_election.cc:302] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e3086842614a898ae02a5710bbb252, db4615171e63417a9d1d8358c60d8b0b; no voters:
I20260924 17:37:20.977061 24535 raft_consensus.cc:2781] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:20.977231 24535 raft_consensus.cc:686] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [term 1 LEADER]: Becoming Leader. State: Replica: db4615171e63417a9d1d8358c60d8b0b, State: Running, Role: LEADER
I20260924 17:37:20.977334 24535 consensus_queue.cc:237] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } }
I20260924 17:37:20.978163 24056 catalog_manager.cc:5495] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b reported cstate change: term changed from 0 to 1, leader changed from <none> to db4615171e63417a9d1d8358c60d8b0b (127.6.37.1). New cstate: current_term: 1 leader_uuid: "db4615171e63417a9d1d8358c60d8b0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "db4615171e63417a9d1d8358c60d8b0b" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 33617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 } health_report { overall_health: UNKNOWN } } }
I20260924 17:37:20.984810 24525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:20.982757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55758 (local address 127.6.37.1:33617)
0924 17:37:20.982799 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:20.982801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:20.982809 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:20.982955 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:20.982956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:20.982970 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:20.983028 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:20.983113 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.983533 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.984184 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:20.984374 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:20.984422 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:20.984555 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:20.984642 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:20.984699 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:20.984729 (+ 30us) server_negotiation.cc:299] Negotiation successful
0924 17:37:20.984743 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:20.986361 24467 raft_consensus.cc:1261] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 1 FOLLOWER]: Refusing update from remote peer db4615171e63417a9d1d8358c60d8b0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:20.986372 24336 raft_consensus.cc:1261] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 1 FOLLOWER]: Refusing update from remote peer db4615171e63417a9d1d8358c60d8b0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:20.986734 24538 consensus_queue.cc:1035] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4c8508de1e740789b191ff85c59149b" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 46857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:20.986855 24535 consensus_queue.cc:1035] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "64e3086842614a898ae02a5710bbb252" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:20.989291 24542 mvcc.cc:205] Tried to move back new op lower bound from 7332951822277705728 to 7332951822243909632. Current Snapshot: MvccSnapshot[applied={T|T < 7332951822277705728}]
I20260924 17:37:20.989809 24544 mvcc.cc:205] Tried to move back new op lower bound from 7332951822277705728 to 7332951822243909632. Current Snapshot: MvccSnapshot[applied={T|T < 7332951822277705728}]
I20260924 17:37:20.991478 24058 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:20.991577 24058 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53286:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:20.992347 24058 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03f208357db44bf688ccc8752c4d14d3: Sending DeleteTablet for 3 replicas of tablet a0f878e95a6c46acb4d317546be915b4
I20260924 17:37:20.992658 24182 tablet_service.cc:1514] Processing DeleteTablet for tablet a0f878e95a6c46acb4d317546be915b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:20 UTC) from {username='slave'} at 127.0.0.1:55746
I20260924 17:37:20.992697 24447 tablet_service.cc:1514] Processing DeleteTablet for tablet a0f878e95a6c46acb4d317546be915b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:20 UTC) from {username='slave'} at 127.0.0.1:51640
I20260924 17:37:20.992699 24314 tablet_service.cc:1514] Processing DeleteTablet for tablet a0f878e95a6c46acb4d317546be915b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:20 UTC) from {username='slave'} at 127.0.0.1:45542
I20260924 17:37:20.992928 24554 tablet_replica.cc:330] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: stopping tablet replica
I20260924 17:37:20.992949 24552 tablet_replica.cc:330] T a0f878e95a6c46acb4d317546be915b4 P db4615171e63417a9d1d8358c60d8b0b: stopping tablet replica
I20260924 17:37:20.993032 24554 raft_consensus.cc:2229] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:20.993139 24554 raft_consensus.cc:2258] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:20.993305 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24119
I20260924 17:37:20.993566 24554 ts_tablet_manager.cc:1905] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:20.995796 24554 ts_tablet_manager.cc:1918] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:20.995877 24554 log.cc:1196] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/a0f878e95a6c46acb4d317546be915b4
I20260924 17:37:20.996142 24554 ts_tablet_manager.cc:1939] T a0f878e95a6c46acb4d317546be915b4 P b4c8508de1e740789b191ff85c59149b: Deleting consensus metadata
I20260924 17:37:20.996573 24043 catalog_manager.cc:4841] TS b4c8508de1e740789b191ff85c59149b (127.6.37.2:46857): tablet a0f878e95a6c46acb4d317546be915b4 (table test-table [id=7b6d79e6feef4e35a598e98d3b83d244]) successfully deleted
W20260924 17:37:21.000437 24042 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:33617 (error 108)
I20260924 17:37:21.000483 24553 tablet_replica.cc:330] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: stopping tablet replica
I20260924 17:37:21.000630 24553 raft_consensus.cc:2229] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:21.000756 24553 raft_consensus.cc:2258] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:21.000941 24524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:21.000802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:33617 (local address 127.0.0.1:55774)
0924 17:37:21.000851 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:21.000902 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:33617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260924 17:37:21.001037 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24252
W20260924 17:37:21.001061 24042 catalog_manager.cc:4584] TS db4615171e63417a9d1d8358c60d8b0b (127.6.37.1:33617): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0f878e95a6c46acb4d317546be915b4: Network error: Client connection negotiation failed: client connection to 127.6.37.1:33617: connect: Connection refused (error 111)
I20260924 17:37:21.001366 24553 ts_tablet_manager.cc:1905] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:21.002910 24553 ts_tablet_manager.cc:1918] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:21.003011 24553 log.cc:1196] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/a0f878e95a6c46acb4d317546be915b4
I20260924 17:37:21.003242 24553 ts_tablet_manager.cc:1939] T a0f878e95a6c46acb4d317546be915b4 P 64e3086842614a898ae02a5710bbb252: Deleting consensus metadata
I20260924 17:37:21.003651 24044 catalog_manager.cc:4841] TS 64e3086842614a898ae02a5710bbb252 (127.6.37.3:39439): tablet a0f878e95a6c46acb4d317546be915b4 (table test-table [id=7b6d79e6feef4e35a598e98d3b83d244]) successfully deleted
I20260924 17:37:21.006119 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24385
I20260924 17:37:21.010852 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24026
2026-09-24T17:37:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (666 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:21 dist-test-slave-gcz9 krb5kdc[24558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:21 dist-test-slave-gcz9 krb5kdc[24558](info): set up 2 sockets
Sep 24 17:37:21 dist-test-slave-gcz9 krb5kdc[24558](info): commencing operation
krb5kdc: starting...
W20260924 17:37:22.077347 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:22.191278 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:44031
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:43955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:44031
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:22.270785 24571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:22.270993 24571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:22.271015 24571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:22.272100 24571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:22.272135 24571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:22.272149 24571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:22.272162 24571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:22.272174 24571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:22.273576 24571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:43955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:44031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:44031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:22.273752 24571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:22.273906 24571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:22.278548 24579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.278540 24576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.278549 24577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:22.278811 24571 server_base.cc:1034] running on GCE node
I20260924 17:37:22.279052 24571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:22.279270 24571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:22.280408 24571 hybrid_clock.cc:648] HybridClock initialized: now 1790271442280387 us; error 36 us; skew 500 ppm
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:22.282672 24571 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:22.283143 24571 webserver.cc:460] Webserver started at http://127.6.37.62:35229/ using document root <none> and password file <none>
I20260924 17:37:22.283356 24571 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:22.283421 24571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:22.283572 24571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:22.284571 24571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "7df778cdc1944704ac5679e896d4203c"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "75ab2e1f59ea80b79cedec3753f23ce6"
server_key_iv: "51b35c1f2ae4a5295664cdc6551d3f35"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.284920 24571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "7df778cdc1944704ac5679e896d4203c"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "75ab2e1f59ea80b79cedec3753f23ce6"
server_key_iv: "51b35c1f2ae4a5295664cdc6551d3f35"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.286252 24571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:22.287004 24586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.287214 24571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:37:22.287315 24571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "7df778cdc1944704ac5679e896d4203c"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "75ab2e1f59ea80b79cedec3753f23ce6"
server_key_iv: "51b35c1f2ae4a5295664cdc6551d3f35"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.287397 24571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:22.309132 24571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:22.311084 24571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:22.311245 24571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:22.315101 24571 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:44031
I20260924 17:37:22.315140 24639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:44031 every 8 connection(s)
I20260924 17:37:22.315523 24571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:22.316151 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24571
I20260924 17:37:22.316277 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:22.316437 24640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:22.316474 6292 external_mini_cluster.cc:1428] Setting key 5f81043573c0aa9db6c7c61d79d816cc
I20260924 17:37:22.320393 24640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c: Bootstrap starting.
I20260924 17:37:22.321061 24640 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:22.321403 24640 log.cc:824] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:22.322113 24640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c: No bootstrap required, opened a new log
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:22.324647 24640 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df778cdc1944704ac5679e896d4203c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44031 } }
I20260924 17:37:22.324837 24640 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:22.324885 24640 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7df778cdc1944704ac5679e896d4203c, State: Initialized, Role: FOLLOWER
I20260924 17:37:22.325042 24640 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df778cdc1944704ac5679e896d4203c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44031 } }
I20260924 17:37:22.325129 24640 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:22.325155 24640 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:22.325217 24640 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:22.325821 24640 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df778cdc1944704ac5679e896d4203c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44031 } }
I20260924 17:37:22.325907 24640 leader_election.cc:302] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7df778cdc1944704ac5679e896d4203c; no voters:
I20260924 17:37:22.326102 24640 leader_election.cc:288] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:22.326157 24645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:22.326333 24645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [term 1 LEADER]: Becoming Leader. State: Replica: 7df778cdc1944704ac5679e896d4203c, State: Running, Role: LEADER
I20260924 17:37:22.326393 24640 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:22.326428 24645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df778cdc1944704ac5679e896d4203c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44031 } }
I20260924 17:37:22.326771 24645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7df778cdc1944704ac5679e896d4203c. Latest consensus state: current_term: 1 leader_uuid: "7df778cdc1944704ac5679e896d4203c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df778cdc1944704ac5679e896d4203c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44031 } } }
I20260924 17:37:22.326886 24645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:22.326786 24647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7df778cdc1944704ac5679e896d4203c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7df778cdc1944704ac5679e896d4203c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 44031 } } }
I20260924 17:37:22.327070 24647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:22.327137 24652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:22.327883 24652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:22.328456 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.317005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48768 (local address 127.6.37.62:44031)
0924 17:37:22.317211 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.317220 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.317254 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:37:22.317940 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.317950 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.318027 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.318181 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:22.318824 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.320311 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.321122 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.321732 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.321864 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.324476 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:22.324480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:22.324480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:22.324493 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:22.326615 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.327127 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.327139 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.327139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.327265 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.327492 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.327493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.327493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.327805 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:22.327960 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.328113 (+ 153us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.328254 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":112,"threads_started":1}
I20260924 17:37:22.330188 24652 catalog_manager.cc:1347] Generated new cluster ID: 38e01860735d4add82d7e427ef26b481
I20260924 17:37:22.330236 24652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:22.341210 24652 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:22.341910 24652 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:22.348259 24652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c: Generated new TSK 0
I20260924 17:37:22.348429 24652 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:37:22.381912 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44031
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:43955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:22.463418 24666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:22.463609 24666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:22.463632 24666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:22.464762 24666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:22.464805 24666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:22.464862 24666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:22.466367 24666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:43955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:22.466621 24666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:22.466850 24666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:22.471738 24671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.471755 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.471808 24672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:22.472126 24666 server_base.cc:1034] running on GCE node
I20260924 17:37:22.472277 24666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:22.472470 24666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:22.473608 24666 hybrid_clock.cc:648] HybridClock initialized: now 1790271442473593 us; error 27 us; skew 500 ppm
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:22.476120 24666 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:37:22.476526 24666 webserver.cc:460] Webserver started at http://127.6.37.1:39599/ using document root <none> and password file <none>
I20260924 17:37:22.476758 24666 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:22.476800 24666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:22.476944 24666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:22.477952 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "7cf33bd5e8e049e3b803c95d7396a2db"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "f1200c2bf6e923b436c46c92997e2040"
server_key_iv: "bbf4d772bd595360718b9e94b07d1811"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.478355 24666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "7cf33bd5e8e049e3b803c95d7396a2db"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "f1200c2bf6e923b436c46c92997e2040"
server_key_iv: "bbf4d772bd595360718b9e94b07d1811"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.479765 24666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:22.480522 24681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.480715 24666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:22.480801 24666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "7cf33bd5e8e049e3b803c95d7396a2db"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "f1200c2bf6e923b436c46c92997e2040"
server_key_iv: "bbf4d772bd595360718b9e94b07d1811"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.480854 24666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:22.493229 24666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:22.495434 24666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:22.495546 24666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:22.495720 24666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:22.496026 24666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:22.496062 24666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.496083 24666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:22.496129 24666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.501773 24666 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:43385
I20260924 17:37:22.501852 24797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:43385 every 8 connection(s)
I20260924 17:37:22.502161 24666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:22.506589 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24666
I20260924 17:37:22.506700 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:37:22.506961 6292 external_mini_cluster.cc:1428] Setting key db0a2601dcc3099e1cee46b8b3540a6a
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:22.512396 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.502851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:44837 (local address 127.6.37.62:44031)
0924 17:37:22.502924 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.502927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.503171 (+ 244us) server_negotiation.cc:407] Connection header received
0924 17:37:22.503698 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.503700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.503713 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.503763 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:22.504670 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.505180 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.506173 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.506405 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.506477 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.508778 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:22.508780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:22.508781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:22.508788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:22.510945 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.511329 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.511330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.511331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.511397 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.511698 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.511699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.511700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.511856 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:22.511931 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.512178 (+ 247us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.512275 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260924 17:37:22.512410 24800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.502822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44031 (local address 127.6.37.1:44837)
0924 17:37:22.503052 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.503087 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.503585 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.503828 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.503832 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.504375 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:22.504567 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.504571 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.505278 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.505280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.506079 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.506082 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.506498 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.506499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.506606 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.507178 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:22.507186 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:22.508687 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:22.511035 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:22.511042 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:22.511043 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:22.511253 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:22.511461 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:22.511462 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:22.511462 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:22.511617 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:22.511924 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:22.511929 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:22.512048 (+ 119us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.512130 (+ 82us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.512252 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":146,"threads_started":1}
I20260924 17:37:22.513067 24798 heartbeater.cc:347] Connected to a master server at 127.6.37.62:44031
I20260924 17:37:22.513180 24798 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:22.513402 24798 heartbeater.cc:511] Master 127.6.37.62:44031 requested a full tablet report, sending...
I20260924 17:37:22.513913 24603 ts_manager.cc:194] Registered new tserver with Master: 7cf33bd5e8e049e3b803c95d7396a2db (127.6.37.1:43385)
I20260924 17:37:22.514541 24603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:44837
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:37:22.533586 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44031
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:43955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:22.619346 24803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:22.619632 24803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:22.619668 24803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:22.621384 24803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:22.621441 24803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:22.621488 24803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:22.623878 24803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:43955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:22.624143 24803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:22.624402 24803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:22.630792 24808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.630805 24809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:22.631247 24803 server_base.cc:1034] running on GCE node
W20260924 17:37:22.632813 24811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:22.633054 24803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:22.633343 24803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:22.634469 24803 hybrid_clock.cc:648] HybridClock initialized: now 1790271442634449 us; error 29 us; skew 500 ppm
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:22.637760 24803 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:37:22.638254 24803 webserver.cc:460] Webserver started at http://127.6.37.2:42709/ using document root <none> and password file <none>
I20260924 17:37:22.638491 24803 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:22.638558 24803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:22.638695 24803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:22.639823 24803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "7c5dc7f0acb1403db7370a8011dc4495"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "9ccb466cb7d5a495636b3d6fda3bbdda"
server_key_iv: "2a5e7508b911900aab907812d6b8aad2"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.640204 24803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "7c5dc7f0acb1403db7370a8011dc4495"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "9ccb466cb7d5a495636b3d6fda3bbdda"
server_key_iv: "2a5e7508b911900aab907812d6b8aad2"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.641708 24803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:22.642516 24818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.642699 24803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:22.642793 24803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "7c5dc7f0acb1403db7370a8011dc4495"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "9ccb466cb7d5a495636b3d6fda3bbdda"
server_key_iv: "2a5e7508b911900aab907812d6b8aad2"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.642907 24803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:22.654585 24803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:22.656983 24803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:22.657141 24803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:22.657371 24803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:22.657691 24803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:22.657744 24803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.657787 24803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:22.657814 24803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.663728 24803 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:37573
I20260924 17:37:22.663779 24933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:37573 every 8 connection(s)
I20260924 17:37:22.664094 24803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:37:22.668283 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24803
I20260924 17:37:22.668391 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:37:22.668618 6292 external_mini_cluster.cc:1428] Setting key b6e16c469dff8ebf49411745f01197f0
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:22.673957 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.664785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:59367 (local address 127.6.37.62:44031)
0924 17:37:22.664845 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.664847 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.665063 (+ 216us) server_negotiation.cc:407] Connection header received
0924 17:37:22.665551 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.665552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.665561 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.665616 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:22.666519 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.667115 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.668240 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.668566 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.668645 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.671063 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:22.671064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:22.671064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:22.671070 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:22.672434 (+ 1364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.672984 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.672985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.672985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.673036 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.673330 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.673330 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.673331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.673428 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:22.673478 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.673830 (+ 352us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.673894 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:37:22.674288 24936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.664768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44031 (local address 127.6.37.2:59367)
0924 17:37:22.664940 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.664981 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.665461 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.665678 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.665681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.666238 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:22.666431 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.666436 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.667205 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.667205 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.668140 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.668143 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.668650 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.668651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.668832 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.669382 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:22.669392 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:22.670974 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:22.672521 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:22.672528 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:22.672531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:22.672882 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:22.673107 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:22.673108 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:22.673108 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:22.673259 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:22.673502 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:22.673509 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:22.673685 (+ 176us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.673815 (+ 130us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.674001 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260924 17:37:22.674840 24934 heartbeater.cc:347] Connected to a master server at 127.6.37.62:44031
I20260924 17:37:22.675004 24934 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:22.675207 24934 heartbeater.cc:511] Master 127.6.37.62:44031 requested a full tablet report, sending...
I20260924 17:37:22.675648 24603 ts_manager.cc:194] Registered new tserver with Master: 7c5dc7f0acb1403db7370a8011dc4495 (127.6.37.2:37573)
I20260924 17:37:22.675976 24603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:59367
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:37:22.694375 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44031
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:43955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:22.774546 24939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:22.774734 24939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:22.774757 24939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:22.775915 24939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:22.775957 24939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:22.775991 24939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:22.777359 24939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:43955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:22.777545 24939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:22.777714 24939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:22.782642 24944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.782610 24947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:22.782619 24945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:22.782649 24939 server_base.cc:1034] running on GCE node
I20260924 17:37:22.783001 24939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:22.783233 24939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:22.784375 24939 hybrid_clock.cc:648] HybridClock initialized: now 1790271442784363 us; error 28 us; skew 500 ppm
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:22.786830 24939 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:37:22.787276 24939 webserver.cc:460] Webserver started at http://127.6.37.3:42553/ using document root <none> and password file <none>
I20260924 17:37:22.787509 24939 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:22.787554 24939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:22.787719 24939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:22.788803 24939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "f1f47b4d7753456d933325a91a899cfd"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "70914d4f3eb331b012a63b155d1bc6d9"
server_key_iv: "e603cf2a800332c741f377770d03fb46"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.789146 24939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "f1f47b4d7753456d933325a91a899cfd"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "70914d4f3eb331b012a63b155d1bc6d9"
server_key_iv: "e603cf2a800332c741f377770d03fb46"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.790573 24939 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:22.791424 24954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.791589 24939 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.791693 24939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "f1f47b4d7753456d933325a91a899cfd"
format_stamp: "Formatted at 2026-09-24 17:37:22 on dist-test-slave-gcz9"
server_key: "70914d4f3eb331b012a63b155d1bc6d9"
server_key_iv: "e603cf2a800332c741f377770d03fb46"
server_key_version: "encryptionkey@0"
I20260924 17:37:22.791767 24939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:22.810835 24939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:22.812835 24939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:22.813000 24939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:22.813227 24939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:22.813529 24939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:22.813584 24939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.813624 24939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:22.813652 24939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:22.819370 24939 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:32883
I20260924 17:37:22.819440 25070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:32883 every 8 connection(s)
I20260924 17:37:22.819764 24939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
Sep 24 17:37:22 dist-test-slave-gcz9 krb5kdc[24558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271442, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:22.828878 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 24939
I20260924 17:37:22.828999 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:37:22.829198 6292 external_mini_cluster.cc:1428] Setting key 5abb676514991b9a388c113f7731ecf3
I20260924 17:37:22.829641 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.820475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:49873 (local address 127.6.37.62:44031)
0924 17:37:22.820544 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.820547 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.820793 (+ 246us) server_negotiation.cc:407] Connection header received
0924 17:37:22.821272 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.821273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.821284 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.821337 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:22.822406 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.823214 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.824164 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.824350 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.824400 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.826501 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:22.826502 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:22.826503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:22.826509 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:22.828094 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.828528 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.828529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.828530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.828591 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.828872 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.828874 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.828874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.829029 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:22.829096 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.829428 (+ 332us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.829511 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:37:22.829852 25073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.820469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:44031 (local address 127.6.37.3:49873)
0924 17:37:22.820651 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.820699 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.821188 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.821415 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.821418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.822047 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:22.822303 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.822308 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.823293 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.823294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.824088 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.824090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.824425 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.824426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.824534 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.825017 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:22.825025 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:22.826414 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:22.828163 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:22.828169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:22.828170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:22.828444 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:22.828667 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:22.828668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:22.828668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:22.828801 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:22.829095 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:22.829104 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:22.829273 (+ 169us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.829392 (+ 119us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.829601 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
I20260924 17:37:22.830276 25071 heartbeater.cc:347] Connected to a master server at 127.6.37.62:44031
I20260924 17:37:22.830384 25071 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:22.830555 25071 heartbeater.cc:511] Master 127.6.37.62:44031 requested a full tablet report, sending...
I20260924 17:37:22.830971 24603 ts_manager.cc:194] Registered new tserver with Master: f1f47b4d7753456d933325a91a899cfd (127.6.37.3:32883)
I20260924 17:37:22.831342 24603 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:49873
I20260924 17:37:22.840914 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:37:22.847890 24643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.842182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48776 (local address 127.6.37.62:44031)
0924 17:37:22.842234 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.842236 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.842326 (+ 90us) server_negotiation.cc:407] Connection header received
0924 17:37:22.842381 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.842382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.842389 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.842435 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:22.842997 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.843434 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.844122 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.844288 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.844336 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.845550 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:22.845551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:22.845552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:22.845557 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:22.846767 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.847167 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.847168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.847168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.847217 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:22.847402 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:22.847403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:22.847403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:22.847522 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:22.847598 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.847720 (+ 122us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.847790 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260924 17:37:22.849457 24603 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:37:22.851039 24603 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:37:22.857614 25087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.853528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34422 (local address 127.6.37.2:37573)
0924 17:37:22.853833 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.853836 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.853847 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:37:22.853890 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.853892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.853904 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.854022 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:22.854388 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.855162 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.856608 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.857166 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.857257 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.857321 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.857486 (+ 165us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.857527 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":98,"threads_started":1}
I20260924 17:37:22.857611 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.853326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37573 (local address 127.0.0.1:34422)
0924 17:37:22.853707 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.853742 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.853801 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.854087 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.854090 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.854093 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:22.854159 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.854161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.855262 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.855263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.856510 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.856513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.857258 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.857259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.857340 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.857356 (+ 16us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.857460 (+ 104us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.857519 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":3,"thread_start_us":81,"threads_started":1}
I20260924 17:37:22.857853 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.853356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43385 (local address 127.0.0.1:50078)
0924 17:37:22.854018 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.854026 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.854072 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.854270 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.854271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.854273 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:22.854324 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.854325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.855578 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.855579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.856713 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.856715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.857625 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.857626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.857690 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.857694 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.857750 (+ 56us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.857796 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":54,"thread_start_us":79,"threads_started":1}
I20260924 17:37:22.857623 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.853328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:32883 (local address 127.0.0.1:39902)
0924 17:37:22.853871 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.853878 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.853937 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.854172 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.854173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.854174 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:22.854230 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.854231 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.855555 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.855556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.856452 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.856455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.857355 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.857357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.857419 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.857423 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.857472 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.857527 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":2,"thread_start_us":82,"threads_started":1}
I20260924 17:37:22.858018 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.853536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39902 (local address 127.6.37.3:32883)
0924 17:37:22.853672 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.853678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.853936 (+ 258us) server_negotiation.cc:407] Connection header received
0924 17:37:22.854000 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.854003 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.854018 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.854093 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:22.854303 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.855427 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.856553 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.857201 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.857269 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.857320 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.857794 (+ 474us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.857837 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260924 17:37:22.858157 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.853636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50078 (local address 127.6.37.1:43385)
0924 17:37:22.853782 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.853787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.854129 (+ 342us) server_negotiation.cc:407] Connection header received
0924 17:37:22.854175 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.854177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.854190 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.854262 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:22.854380 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.855481 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.856790 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.857465 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.857537 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.857592 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.858010 (+ 418us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.858060 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260924 17:37:22.858312 24867 tablet_service.cc:1467] Processing CreateTablet for tablet f1fd7ba335fd4c5795ada9ae94e34f21 (DEFAULT_TABLE table=test-table [id=2df86c82f7d54d829226a435ab3ea48f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:22.858681 24867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1fd7ba335fd4c5795ada9ae94e34f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:22.858747 24729 tablet_service.cc:1467] Processing CreateTablet for tablet f1fd7ba335fd4c5795ada9ae94e34f21 (DEFAULT_TABLE table=test-table [id=2df86c82f7d54d829226a435ab3ea48f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:22.858783 25002 tablet_service.cc:1467] Processing CreateTablet for tablet f1fd7ba335fd4c5795ada9ae94e34f21 (DEFAULT_TABLE table=test-table [id=2df86c82f7d54d829226a435ab3ea48f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:22.859097 24729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1fd7ba335fd4c5795ada9ae94e34f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:22.859133 25002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1fd7ba335fd4c5795ada9ae94e34f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:22.861450 25089 tablet_bootstrap.cc:492] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: Bootstrap starting.
I20260924 17:37:22.862123 25089 tablet_bootstrap.cc:654] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:22.862097 25090 tablet_bootstrap.cc:492] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Bootstrap starting.
I20260924 17:37:22.862288 25091 tablet_bootstrap.cc:492] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Bootstrap starting.
I20260924 17:37:22.862802 25090 tablet_bootstrap.cc:654] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:22.862995 25091 tablet_bootstrap.cc:654] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:22.862975 25089 log.cc:824] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:22.863405 25090 log.cc:824] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:22.863620 25091 log.cc:824] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:22.863910 25089 tablet_bootstrap.cc:492] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: No bootstrap required, opened a new log
I20260924 17:37:22.864001 25089 ts_tablet_manager.cc:1397] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260924 17:37:22.864323 25091 tablet_bootstrap.cc:492] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: No bootstrap required, opened a new log
I20260924 17:37:22.864377 25091 ts_tablet_manager.cc:1397] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:37:22.865523 25089 raft_consensus.cc:348] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.865705 25089 raft_consensus.cc:374] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:22.865756 25089 raft_consensus.cc:729] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cf33bd5e8e049e3b803c95d7396a2db, State: Initialized, Role: FOLLOWER
I20260924 17:37:22.865868 25089 consensus_queue.cc:260] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.865983 25091 raft_consensus.cc:348] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.866178 25091 raft_consensus.cc:374] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:22.866182 25089 ts_tablet_manager.cc:1428] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:22.866220 24798 heartbeater.cc:503] Master 127.6.37.62:44031 was elected leader, sending a full tablet report...
I20260924 17:37:22.866221 25091 raft_consensus.cc:729] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f47b4d7753456d933325a91a899cfd, State: Initialized, Role: FOLLOWER
I20260924 17:37:22.866333 25091 consensus_queue.cc:260] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.866637 25091 ts_tablet_manager.cc:1428] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260924 17:37:22.866644 25071 heartbeater.cc:503] Master 127.6.37.62:44031 was elected leader, sending a full tablet report...
I20260924 17:37:22.866938 25090 tablet_bootstrap.cc:492] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: No bootstrap required, opened a new log
I20260924 17:37:22.867053 25090 ts_tablet_manager.cc:1397] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260924 17:37:22.868829 25090 raft_consensus.cc:348] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.869041 25090 raft_consensus.cc:374] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:22.869095 25090 raft_consensus.cc:729] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c5dc7f0acb1403db7370a8011dc4495, State: Initialized, Role: FOLLOWER
I20260924 17:37:22.869195 25090 consensus_queue.cc:260] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.869457 25090 ts_tablet_manager.cc:1428] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:22.869491 24934 heartbeater.cc:503] Master 127.6.37.62:44031 was elected leader, sending a full tablet report...
W20260924 17:37:22.914727 24935 tablet.cc:2369] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:22.944471 25095 raft_consensus.cc:482] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:22.944631 25095 raft_consensus.cc:504] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.945011 25095 leader_election.cc:288] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1f47b4d7753456d933325a91a899cfd (127.6.37.3:32883), 7c5dc7f0acb1403db7370a8011dc4495 (127.6.37.2:37573)
I20260924 17:37:22.948145 25098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.945196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:37573 (local address 127.6.37.1:60143)
0924 17:37:22.945565 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.945575 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.945634 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.945781 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.945781 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.945783 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:22.945851 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.945852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.946490 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.946491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.947347 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.947350 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.947887 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.947888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.947962 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.947965 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.948010 (+ 45us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.948039 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":190,"thread_start_us":125,"threads_started":1}
I20260924 17:37:22.948154 25087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.945288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:60143 (local address 127.6.37.2:37573)
0924 17:37:22.945374 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.945376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.945666 (+ 290us) server_negotiation.cc:407] Connection header received
0924 17:37:22.945698 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.945699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.945712 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.945758 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:22.945924 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.946405 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.947437 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.947799 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.947854 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.947863 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.948040 (+ 177us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.948090 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260924 17:37:22.948220 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.945288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:41669 (local address 127.6.37.3:32883)
0924 17:37:22.945346 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.945348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.945358 (+ 10us) server_negotiation.cc:407] Connection header received
0924 17:37:22.945393 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.945394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.945406 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.945500 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:22.945724 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.946297 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.947443 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.947814 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.947900 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.947910 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.948103 (+ 193us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.948143 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:37:22.948258 24800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.945196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:32883 (local address 127.6.37.1:41669)
0924 17:37:22.945257 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.945288 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:22.945332 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:22.945533 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:22.945535 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:22.945537 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:22.945614 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.945634 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.946394 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.946396 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.947345 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:22.947347 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.947921 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.947922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:22.948022 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.948026 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:22.948084 (+ 58us) client_negotiation.cc:240] Negotiation successful
0924 17:37:22.948122 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":49}
I20260924 17:37:22.948587 24887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1fd7ba335fd4c5795ada9ae94e34f21" candidate_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5dc7f0acb1403db7370a8011dc4495" is_pre_election: true
I20260924 17:37:22.948603 25024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1fd7ba335fd4c5795ada9ae94e34f21" candidate_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f47b4d7753456d933325a91a899cfd" is_pre_election: true
I20260924 17:37:22.948745 24887 raft_consensus.cc:2454] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cf33bd5e8e049e3b803c95d7396a2db in term 0.
I20260924 17:37:22.948755 25024 raft_consensus.cc:2454] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7cf33bd5e8e049e3b803c95d7396a2db in term 0.
I20260924 17:37:22.948979 24685 leader_election.cc:302] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c5dc7f0acb1403db7370a8011dc4495, 7cf33bd5e8e049e3b803c95d7396a2db; no voters:
I20260924 17:37:22.949172 25095 raft_consensus.cc:2781] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:37:22.949227 25095 raft_consensus.cc:482] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:37:22.949254 25095 raft_consensus.cc:3037] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:22.949965 25095 raft_consensus.cc:504] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.950106 25095 leader_election.cc:288] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [CANDIDATE]: Term 1 election: Requested vote from peers f1f47b4d7753456d933325a91a899cfd (127.6.37.3:32883), 7c5dc7f0acb1403db7370a8011dc4495 (127.6.37.2:37573)
I20260924 17:37:22.950269 25024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1fd7ba335fd4c5795ada9ae94e34f21" candidate_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1f47b4d7753456d933325a91a899cfd"
I20260924 17:37:22.950282 24887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1fd7ba335fd4c5795ada9ae94e34f21" candidate_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c5dc7f0acb1403db7370a8011dc4495"
I20260924 17:37:22.950351 25024 raft_consensus.cc:3037] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:22.950351 24887 raft_consensus.cc:3037] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:22.951236 25024 raft_consensus.cc:2454] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cf33bd5e8e049e3b803c95d7396a2db in term 1.
I20260924 17:37:22.951236 24887 raft_consensus.cc:2454] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7cf33bd5e8e049e3b803c95d7396a2db in term 1.
I20260924 17:37:22.951431 24683 leader_election.cc:302] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7cf33bd5e8e049e3b803c95d7396a2db, f1f47b4d7753456d933325a91a899cfd; no voters:
I20260924 17:37:22.951534 25095 raft_consensus.cc:2781] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:22.951682 25095 raft_consensus.cc:686] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 1 LEADER]: Becoming Leader. State: Replica: 7cf33bd5e8e049e3b803c95d7396a2db, State: Running, Role: LEADER
I20260924 17:37:22.951752 25095 consensus_queue.cc:237] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } }
I20260924 17:37:22.952579 24603 catalog_manager.cc:5495] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db reported cstate change: term changed from 0 to 1, leader changed from <none> to 7cf33bd5e8e049e3b803c95d7396a2db (127.6.37.1). New cstate: current_term: 1 leader_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7cf33bd5e8e049e3b803c95d7396a2db" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 43385 } health_report { overall_health: HEALTHY } } }
I20260924 17:37:22.976673 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.974552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50094 (local address 127.6.37.1:43385)
0924 17:37:22.974601 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:22.974602 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:22.974609 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:37:22.974658 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:22.974658 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:22.974676 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:22.974737 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:22.974843 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.975302 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.976019 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:22.976216 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:22.976265 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:22.976393 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:22.976479 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:22.976554 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:22.976606 (+ 52us) server_negotiation.cc:299] Negotiation successful
0924 17:37:22.976615 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:22.978545 25024 raft_consensus.cc:1261] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 1 FOLLOWER]: Refusing update from remote peer 7cf33bd5e8e049e3b803c95d7396a2db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:22.978566 24887 raft_consensus.cc:1261] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 1 FOLLOWER]: Refusing update from remote peer 7cf33bd5e8e049e3b803c95d7396a2db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:22.978965 25095 consensus_queue.cc:1035] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c5dc7f0acb1403db7370a8011dc4495" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:22.979120 25099 consensus_queue.cc:1035] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1f47b4d7753456d933325a91a899cfd" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:22.981680 25103 mvcc.cc:205] Tried to move back new op lower bound from 7332951830437031936 to 7332951830331047936. Current Snapshot: MvccSnapshot[applied={T|T < 7332951830437031936}]
I20260924 17:37:22.981923 25104 mvcc.cc:205] Tried to move back new op lower bound from 7332951830437031936 to 7332951830331047936. Current Snapshot: MvccSnapshot[applied={T|T < 7332951830437031936}]
I20260924 17:37:22.983611 24602 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:22.983711 24602 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:22.984483 24602 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7df778cdc1944704ac5679e896d4203c: Sending DeleteTablet for 3 replicas of tablet f1fd7ba335fd4c5795ada9ae94e34f21
I20260924 17:37:22.984779 25002 tablet_service.cc:1514] Processing DeleteTablet for tablet f1fd7ba335fd4c5795ada9ae94e34f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:39902
I20260924 17:37:22.984817 24729 tablet_service.cc:1514] Processing DeleteTablet for tablet f1fd7ba335fd4c5795ada9ae94e34f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:50078
I20260924 17:37:22.984903 24867 tablet_service.cc:1514] Processing DeleteTablet for tablet f1fd7ba335fd4c5795ada9ae94e34f21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:22 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:34422
I20260924 17:37:22.985045 25113 tablet_replica.cc:330] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db: stopping tablet replica
I20260924 17:37:22.985105 25115 tablet_replica.cc:330] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: stopping tablet replica
I20260924 17:37:22.985131 25113 raft_consensus.cc:2229] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:37:22.985196 25115 raft_consensus.cc:2229] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:22.985212 25113 raft_consensus.cc:2258] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7cf33bd5e8e049e3b803c95d7396a2db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:22.985411 25112 tablet_replica.cc:330] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: stopping tablet replica
I20260924 17:37:22.985478 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24666
I20260924 17:37:22.985540 25112 raft_consensus.cc:2229] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:22.986239 25112 raft_consensus.cc:2258] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:22.986753 25112 ts_tablet_manager.cc:1905] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:22.987802 25115 raft_consensus.cc:2258] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:22.988204 25115 ts_tablet_manager.cc:1905] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:22.988699 25112 ts_tablet_manager.cc:1918] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:22.988772 25112 log.cc:1196] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/f1fd7ba335fd4c5795ada9ae94e34f21
I20260924 17:37:22.989048 25112 ts_tablet_manager.cc:1939] T f1fd7ba335fd4c5795ada9ae94e34f21 P f1f47b4d7753456d933325a91a899cfd: Deleting consensus metadata
I20260924 17:37:22.989445 24588 catalog_manager.cc:4841] TS f1f47b4d7753456d933325a91a899cfd (127.6.37.3:32883): tablet f1fd7ba335fd4c5795ada9ae94e34f21 (table test-table [id=2df86c82f7d54d829226a435ab3ea48f]) successfully deleted
I20260924 17:37:22.989696 25115 ts_tablet_manager.cc:1918] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:22.989796 25115 log.cc:1196] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/f1fd7ba335fd4c5795ada9ae94e34f21
I20260924 17:37:22.990041 25115 ts_tablet_manager.cc:1939] T f1fd7ba335fd4c5795ada9ae94e34f21 P 7c5dc7f0acb1403db7370a8011dc4495: Deleting consensus metadata
I20260924 17:37:22.990478 24590 catalog_manager.cc:4841] TS 7c5dc7f0acb1403db7370a8011dc4495 (127.6.37.2:37573): tablet f1fd7ba335fd4c5795ada9ae94e34f21 (table test-table [id=2df86c82f7d54d829226a435ab3ea48f]) successfully deleted
W20260924 17:37:22.992779 24589 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:43385 (error 108)
I20260924 17:37:22.992983 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24803
I20260924 17:37:22.993762 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:22.993147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:43385 (local address 127.0.0.1:50102)
0924 17:37:22.993701 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:22.993736 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:43385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536}
W20260924 17:37:22.993909 24589 catalog_manager.cc:4584] TS 7cf33bd5e8e049e3b803c95d7396a2db (127.6.37.1:43385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f1fd7ba335fd4c5795ada9ae94e34f21: Network error: Client connection negotiation failed: client connection to 127.6.37.1:43385: connect: Connection refused (error 111)
I20260924 17:37:22.998835 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24939
I20260924 17:37:23.003451 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 24571
2026-09-24T17:37:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1992 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-24T17:37:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:23Z Disabled control of system clock
I20260924 17:37:23.030503 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:37065
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:45473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:37065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:23.110610 25120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:23.110816 25120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:23.110836 25120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:23.112030 25120 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:23.112072 25120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:23.112084 25120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:23.112097 25120 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:23.112109 25120 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:23.113358 25120 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:37065
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:37065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:23.113548 25120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:23.113760 25120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:23.118350 25125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:23.118338 25126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:23.118340 25128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:23.118588 25120 server_base.cc:1034] running on GCE node
I20260924 17:37:23.118817 25120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:23.119133 25120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:23.120280 25120 hybrid_clock.cc:648] HybridClock initialized: now 1790271443120261 us; error 38 us; skew 500 ppm
I20260924 17:37:23.121584 25120 webserver.cc:460] Webserver started at http://127.6.37.62:39883/ using document root <none> and password file <none>
I20260924 17:37:23.121824 25120 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:23.121870 25120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:23.122046 25120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:23.123245 25120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "af364f8a3f8842e59e85e525100f7bee"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "2e11bc6a33d84c9a326cc03e0375bf63"
server_key_iv: "ecda3c98e7cf52ea4ab1f91baa2a3bb5"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.123610 25120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "af364f8a3f8842e59e85e525100f7bee"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "2e11bc6a33d84c9a326cc03e0375bf63"
server_key_iv: "ecda3c98e7cf52ea4ab1f91baa2a3bb5"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.124964 25120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:23.125622 25134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.125808 25120 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:23.125900 25120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "af364f8a3f8842e59e85e525100f7bee"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "2e11bc6a33d84c9a326cc03e0375bf63"
server_key_iv: "ecda3c98e7cf52ea4ab1f91baa2a3bb5"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.125973 25120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:23.168351 25120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:23.168721 25120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:23.168879 25120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:23.172858 25120 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:37065
I20260924 17:37:23.172894 25186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:37065 every 8 connection(s)
I20260924 17:37:23.173251 25120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:23.174191 25187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:23.174810 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25120
I20260924 17:37:23.174942 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:23.175186 6292 external_mini_cluster.cc:1428] Setting key 043b964019f266b01846ea14295f9549
I20260924 17:37:23.177436 25187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee: Bootstrap starting.
I20260924 17:37:23.178113 25187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:23.178406 25187 log.cc:824] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:23.179193 25187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee: No bootstrap required, opened a new log
I20260924 17:37:23.180932 25187 raft_consensus.cc:348] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af364f8a3f8842e59e85e525100f7bee" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37065 } }
I20260924 17:37:23.181131 25187 raft_consensus.cc:374] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:23.181185 25187 raft_consensus.cc:729] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af364f8a3f8842e59e85e525100f7bee, State: Initialized, Role: FOLLOWER
I20260924 17:37:23.181242 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.175723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.6.37.62:37065)
0924 17:37:23.175943 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.175952 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.176002 (+ 50us) server_negotiation.cc:407] Connection header received
0924 17:37:23.176592 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.176602 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.176686 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.176835 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:23.177020 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.178334 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.179299 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.179710 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.179856 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.180543 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:23.180547 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:23.180547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:23.180719 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:23.180751 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:23.180761 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:23.180842 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.180918 (+ 76us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.181057 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260924 17:37:23.181351 25187 consensus_queue.cc:260] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af364f8a3f8842e59e85e525100f7bee" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37065 } }
I20260924 17:37:23.181440 25187 raft_consensus.cc:388] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:23.181469 25187 raft_consensus.cc:482] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:23.181522 25187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:23.182096 25187 raft_consensus.cc:504] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af364f8a3f8842e59e85e525100f7bee" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37065 } }
I20260924 17:37:23.182179 25187 leader_election.cc:302] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af364f8a3f8842e59e85e525100f7bee; no voters:
I20260924 17:37:23.182392 25187 leader_election.cc:288] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:23.182417 25192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:23.182603 25192 raft_consensus.cc:686] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [term 1 LEADER]: Becoming Leader. State: Replica: af364f8a3f8842e59e85e525100f7bee, State: Running, Role: LEADER
I20260924 17:37:23.182672 25187 sys_catalog.cc:564] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:23.182698 25192 consensus_queue.cc:237] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af364f8a3f8842e59e85e525100f7bee" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37065 } }
I20260924 17:37:23.183188 25193 sys_catalog.cc:455] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af364f8a3f8842e59e85e525100f7bee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af364f8a3f8842e59e85e525100f7bee" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37065 } } }
I20260924 17:37:23.183175 25194 sys_catalog.cc:455] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [sys.catalog]: SysCatalogTable state changed. Reason: New leader af364f8a3f8842e59e85e525100f7bee. Latest consensus state: current_term: 1 leader_uuid: "af364f8a3f8842e59e85e525100f7bee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af364f8a3f8842e59e85e525100f7bee" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 37065 } } }
I20260924 17:37:23.183286 25193 sys_catalog.cc:458] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:23.183293 25194 sys_catalog.cc:458] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:23.183506 25201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:23.184048 25201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:23.185568 25201 catalog_manager.cc:1347] Generated new cluster ID: 3b1720fabcb1441881fd85469dc5d75a
I20260924 17:37:23.185642 25201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:23.197291 25201 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:23.198012 25201 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:23.213447 25201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee: Generated new TSK 0
I20260924 17:37:23.213663 25201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:23.217797 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37065
--builtin_ntp_servers=127.6.37.20:45473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:23.306433 25212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:23.306630 25212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:23.306653 25212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:23.307850 25212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:23.307889 25212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:23.307915 25212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:23.309221 25212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:23.309458 25212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:23.309775 25212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:23.314777 25218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:23.314982 25212 server_base.cc:1034] running on GCE node
W20260924 17:37:23.314764 25217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:23.314755 25220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:23.315336 25212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:23.315605 25212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:23.316793 25212 hybrid_clock.cc:648] HybridClock initialized: now 1790271443316773 us; error 31 us; skew 500 ppm
I20260924 17:37:23.318308 25212 webserver.cc:460] Webserver started at http://127.6.37.1:35595/ using document root <none> and password file <none>
I20260924 17:37:23.318558 25212 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:23.318616 25212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:23.318740 25212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:23.320169 25212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "6a3338b95dd9ef6a696c6b948c8026d8"
server_key_iv: "054ac86ad8c0405ef3277534e32b73f6"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.320554 25212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "6a3338b95dd9ef6a696c6b948c8026d8"
server_key_iv: "054ac86ad8c0405ef3277534e32b73f6"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.322130 25212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:37:23.322975 25226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.323154 25212 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:23.323242 25212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "6a3338b95dd9ef6a696c6b948c8026d8"
server_key_iv: "054ac86ad8c0405ef3277534e32b73f6"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.323309 25212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:23.335889 25212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:23.336172 25212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:23.336275 25212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:23.336455 25212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:23.336808 25212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:23.336843 25212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.336899 25212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:23.336926 25212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.342696 25212 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:36309
I20260924 17:37:23.342752 25341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:36309 every 8 connection(s)
I20260924 17:37:23.343114 25212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:23.343330 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25212
I20260924 17:37:23.343444 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:37:23.343734 6292 external_mini_cluster.cc:1428] Setting key 4019129377f3c540434641bea6aa0cf2
I20260924 17:37:23.344759 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37065
--builtin_ntp_servers=127.6.37.20:45473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 17:37:23.356904 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.343934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:50015 (local address 127.6.37.62:37065)
0924 17:37:23.344007 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.344009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.344326 (+ 317us) server_negotiation.cc:407] Connection header received
0924 17:37:23.344956 (+ 630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.344957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.344974 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.345004 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:23.345804 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.346359 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.347572 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.347756 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.347839 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.356586 (+ 8747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:23.356588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:23.356589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:23.356596 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:23.356617 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:23.356621 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:23.356683 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.356781 (+ 98us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.356820 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:37:23.357165 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.343941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37065 (local address 127.6.37.1:50015)
0924 17:37:23.344184 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.344242 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.344791 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.345163 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.345166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.345174 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:23.345677 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.345681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.346452 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.346454 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.347489 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.347498 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.347849 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.347851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.348002 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.356413 (+ 8411us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:23.356414 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:23.356450 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:23.356481 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:23.356687 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:23.356695 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:23.356699 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.356784 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.356905 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
I20260924 17:37:23.357718 25342 heartbeater.cc:347] Connected to a master server at 127.6.37.62:37065
I20260924 17:37:23.357826 25342 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:23.358033 25342 heartbeater.cc:511] Master 127.6.37.62:37065 requested a full tablet report, sending...
I20260924 17:37:23.358543 25151 ts_manager.cc:194] Registered new tserver with Master: 0c313fa3d8ae45bbacf7dc6af7a4c0dc (127.6.37.1:36309)
I20260924 17:37:23.359259 25151 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.1:50015
W20260924 17:37:23.426987 25345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:23.427318 25345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:23.427350 25345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:23.428864 25345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:23.428901 25345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:23.428927 25345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:23.430420 25345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25345
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:23.430682 25345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:23.431036 25345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:23.436093 25354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:23.436074 25351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:23.436071 25352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:23.436103 25345 server_base.cc:1034] running on GCE node
I20260924 17:37:23.436578 25345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:23.436818 25345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:23.437979 25345 hybrid_clock.cc:648] HybridClock initialized: now 1790271443437960 us; error 31 us; skew 500 ppm
I20260924 17:37:23.439301 25345 webserver.cc:460] Webserver started at http://127.6.37.2:44983/ using document root <none> and password file <none>
I20260924 17:37:23.439577 25345 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:23.439652 25345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:23.439805 25345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:23.441246 25345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "7afab51738fc4a79a7a4e2a14201d1f3"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "6f5d53a13fd164590a52d1cb6faeee97"
server_key_iv: "43c8e65840a34f8823f72147c0057a00"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.441695 25345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "7afab51738fc4a79a7a4e2a14201d1f3"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "6f5d53a13fd164590a52d1cb6faeee97"
server_key_iv: "43c8e65840a34f8823f72147c0057a00"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.443308 25345 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260924 17:37:23.444164 25360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.444340 25345 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:23.444463 25345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "7afab51738fc4a79a7a4e2a14201d1f3"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "6f5d53a13fd164590a52d1cb6faeee97"
server_key_iv: "43c8e65840a34f8823f72147c0057a00"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.444552 25345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:23.456596 25345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:23.456933 25345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:23.457111 25345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:23.457374 25345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:23.457733 25345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:23.457808 25345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.457860 25345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:23.457892 25345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.464639 25345 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:44039
I20260924 17:37:23.464677 25475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:44039 every 8 connection(s)
I20260924 17:37:23.465047 25345 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:37:23.470412 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25345
I20260924 17:37:23.470525 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:37:23.470759 6292 external_mini_cluster.cc:1428] Setting key 4577798b15fb4e732078fbe14584c4bd
I20260924 17:37:23.470873 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.465784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:38811 (local address 127.6.37.62:37065)
0924 17:37:23.465843 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.465845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.466073 (+ 228us) server_negotiation.cc:407] Connection header received
0924 17:37:23.466605 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.466606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.466620 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.466671 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:23.467416 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.468227 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.469402 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.469635 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.469721 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.470548 (+ 827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:23.470549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:23.470550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:23.470555 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:23.470571 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:23.470576 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:23.470629 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.470760 (+ 131us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.470784 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:37:23.471184 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.465732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37065 (local address 127.6.37.2:38811)
0924 17:37:23.465912 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.465953 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.466494 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.466753 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.466757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.466774 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:23.467284 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.467289 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.468331 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.468332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.469312 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.469315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.469734 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.469735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.469868 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.470405 (+ 537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:23.470405 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:23.470433 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:23.470456 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:23.470651 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:23.470659 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:23.470663 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.470758 (+ 95us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.470947 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260924 17:37:23.471599 25476 heartbeater.cc:347] Connected to a master server at 127.6.37.62:37065
I20260924 17:37:23.471688 25476 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:23.471882 25476 heartbeater.cc:511] Master 127.6.37.62:37065 requested a full tablet report, sending...
I20260924 17:37:23.471884 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37065
--builtin_ntp_servers=127.6.37.20:45473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 17:37:23.472220 25151 ts_manager.cc:194] Registered new tserver with Master: 7afab51738fc4a79a7a4e2a14201d1f3 (127.6.37.2:44039)
I20260924 17:37:23.472599 25151 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.2:38811
W20260924 17:37:23.555071 25479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:23.555282 25479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:23.555318 25479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:23.556455 25479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:23.556519 25479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:23.556568 25479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:23.557901 25479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:37065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:23.558158 25479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:23.558436 25479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:23.563345 25484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:23.563426 25479 server_base.cc:1034] running on GCE node
W20260924 17:37:23.563369 25485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:23.563380 25487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:23.563751 25479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:23.563951 25479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:23.565094 25479 hybrid_clock.cc:648] HybridClock initialized: now 1790271443565082 us; error 28 us; skew 500 ppm
I20260924 17:37:23.566365 25479 webserver.cc:460] Webserver started at http://127.6.37.3:40937/ using document root <none> and password file <none>
I20260924 17:37:23.566587 25479 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:23.566630 25479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:23.566779 25479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:23.567844 25479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "28c8445a16804da9821fe3e8b1108bc7"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "e76f53fcd7f10c8ebed64fdd8345a0ec"
server_key_iv: "8eda5e1df5006b98af43b0e3fb7c7b42"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.568187 25479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "28c8445a16804da9821fe3e8b1108bc7"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "e76f53fcd7f10c8ebed64fdd8345a0ec"
server_key_iv: "8eda5e1df5006b98af43b0e3fb7c7b42"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.569597 25479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260924 17:37:23.570266 25493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.570443 25479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:23.570530 25479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "28c8445a16804da9821fe3e8b1108bc7"
format_stamp: "Formatted at 2026-09-24 17:37:23 on dist-test-slave-gcz9"
server_key: "e76f53fcd7f10c8ebed64fdd8345a0ec"
server_key_iv: "8eda5e1df5006b98af43b0e3fb7c7b42"
server_key_version: "encryptionkey@0"
I20260924 17:37:23.570600 25479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:23.602212 25479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:23.602617 25479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:23.602775 25479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:23.603041 25479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:23.603412 25479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:23.603447 25479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.603470 25479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:23.603483 25479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:23.609217 25479 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:46327
I20260924 17:37:23.609279 25609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:46327 every 8 connection(s)
I20260924 17:37:23.609623 25479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:37:23.614705 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.610351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:59171 (local address 127.6.37.62:37065)
0924 17:37:23.610425 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.610427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.610661 (+ 234us) server_negotiation.cc:407] Connection header received
0924 17:37:23.611304 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.611306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.611319 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.611375 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:23.612035 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.612528 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.613454 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.613639 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.613689 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.614473 (+ 784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:23.614474 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:23.614475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:23.614479 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:23.614492 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:23.614496 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:23.614538 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.614624 (+ 86us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.614645 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:37:23.614960 25613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.610359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:37065 (local address 127.6.37.3:59171)
0924 17:37:23.610529 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.610563 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.611205 (+ 642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.611436 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.611439 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.611447 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:23.611949 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.611954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.612613 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.612614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.613379 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.613380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.613716 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.613717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.613824 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.614342 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:23.614343 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:23.614370 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:23.614393 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:23.614552 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:23.614556 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:23.614559 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.614610 (+ 51us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.614689 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260924 17:37:23.615520 25610 heartbeater.cc:347] Connected to a master server at 127.6.37.62:37065
I20260924 17:37:23.615625 25610 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:23.615803 25610 heartbeater.cc:511] Master 127.6.37.62:37065 requested a full tablet report, sending...
I20260924 17:37:23.616261 25151 ts_manager.cc:194] Registered new tserver with Master: 28c8445a16804da9821fe3e8b1108bc7 (127.6.37.3:46327)
I20260924 17:37:23.616626 25151 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.3:59171
I20260924 17:37:23.617107 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25479
I20260924 17:37:23.617209 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:37:23.617424 6292 external_mini_cluster.cc:1428] Setting key cd4579d6fddb26a494fc65f7a96f8ac6
I20260924 17:37:23.618252 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:37:23.622309 25190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.619594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59180 (local address 127.6.37.62:37065)
0924 17:37:23.619634 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.619636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.619799 (+ 163us) server_negotiation.cc:407] Connection header received
0924 17:37:23.619825 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.619826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.619834 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.619880 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:23.620041 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.620479 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.621169 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.621347 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.621398 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.621997 (+ 599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:23.621998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:23.621998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:23.622002 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:23.622013 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:23.622017 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:23.622085 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.622193 (+ 108us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.622206 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:23.623929 25151 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:37:23.625468 25151 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:37:23.631879 25621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.627475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36309 (local address 127.0.0.1:37338)
0924 17:37:23.627664 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.627705 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.627772 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.628325 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.628329 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.628332 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:23.628403 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.628405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.629718 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.629719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.630902 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.630905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.631556 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.631557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.631644 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.631660 (+ 16us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.631732 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.631790 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":56,"thread_start_us":76,"threads_started":1}
I20260924 17:37:23.631908 25624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.627974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37338 (local address 127.6.37.1:36309)
0924 17:37:23.628111 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.628114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.628142 (+ 28us) server_negotiation.cc:407] Connection header received
0924 17:37:23.628185 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.628187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.628204 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.628495 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:23.628563 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.629639 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.630990 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.631471 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.631530 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.631591 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.631777 (+ 186us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.631825 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":75,"threads_started":1}
I20260924 17:37:23.632014 25619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.627509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:44039 (local address 127.0.0.1:49264)
0924 17:37:23.628296 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.628305 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.628381 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.628631 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.628632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.628634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:23.628684 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.628686 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.630005 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.630006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.631002 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.631004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.631781 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.631782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.631835 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.631838 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.631884 (+ 46us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.631926 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":777,"mutex_wait_us":12,"thread_start_us":83,"threads_started":1}
I20260924 17:37:23.632280 25623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.627756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49264 (local address 127.6.37.2:44039)
0924 17:37:23.627960 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.627964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.628354 (+ 390us) server_negotiation.cc:407] Connection header received
0924 17:37:23.628476 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.628479 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.628493 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.628544 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:23.628789 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.629920 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.631061 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.631592 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.631660 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.631747 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.632147 (+ 400us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.632180 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":123,"threads_started":1}
I20260924 17:37:23.632695 25276 tablet_service.cc:1467] Processing CreateTablet for tablet 56cad2d65d134acab3095edf0fddc397 (DEFAULT_TABLE table=test-table [id=bcbfa1581f7b43a4b904088e991e7275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:23.632937 25409 tablet_service.cc:1467] Processing CreateTablet for tablet 56cad2d65d134acab3095edf0fddc397 (DEFAULT_TABLE table=test-table [id=bcbfa1581f7b43a4b904088e991e7275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:23.633185 25276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56cad2d65d134acab3095edf0fddc397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:23.633308 25409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56cad2d65d134acab3095edf0fddc397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:23.633522 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.627509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:46327 (local address 127.0.0.1:34386)
0924 17:37:23.628115 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.628124 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.628212 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.628525 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.628526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.628528 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:23.628586 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.628588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.629549 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.629550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.630835 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.630838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.633267 (+ 2429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.633268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.633350 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.633355 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.633411 (+ 56us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.633455 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":62,"threads_started":1}
I20260924 17:37:23.633807 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.627741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34386 (local address 127.6.37.3:46327)
0924 17:37:23.627917 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.627921 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.628206 (+ 285us) server_negotiation.cc:407] Connection header received
0924 17:37:23.628289 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.628292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.628321 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.628463 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:23.628695 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.629452 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.631615 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.632775 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.633149 (+ 374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.633239 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.633684 (+ 445us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.633725 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260924 17:37:23.634389 25542 tablet_service.cc:1467] Processing CreateTablet for tablet 56cad2d65d134acab3095edf0fddc397 (DEFAULT_TABLE table=test-table [id=bcbfa1581f7b43a4b904088e991e7275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:23.634716 25542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56cad2d65d134acab3095edf0fddc397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:23.636562 25625 tablet_bootstrap.cc:492] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Bootstrap starting.
I20260924 17:37:23.636729 25626 tablet_bootstrap.cc:492] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Bootstrap starting.
I20260924 17:37:23.637296 25625 tablet_bootstrap.cc:654] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:23.637440 25626 tablet_bootstrap.cc:654] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:23.637660 25625 log.cc:824] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:23.637758 25626 log.cc:824] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:23.637950 25627 tablet_bootstrap.cc:492] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Bootstrap starting.
I20260924 17:37:23.638520 25625 tablet_bootstrap.cc:492] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: No bootstrap required, opened a new log
I20260924 17:37:23.638536 25627 tablet_bootstrap.cc:654] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:23.638608 25625 ts_tablet_manager.cc:1397] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:23.638756 25626 tablet_bootstrap.cc:492] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: No bootstrap required, opened a new log
I20260924 17:37:23.638831 25626 ts_tablet_manager.cc:1397] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:23.638896 25627 log.cc:824] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:23.639760 25627 tablet_bootstrap.cc:492] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: No bootstrap required, opened a new log
I20260924 17:37:23.639832 25627 ts_tablet_manager.cc:1397] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:23.640784 25625 raft_consensus.cc:348] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.640945 25625 raft_consensus.cc:374] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:23.640997 25625 raft_consensus.cc:729] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c313fa3d8ae45bbacf7dc6af7a4c0dc, State: Initialized, Role: FOLLOWER
I20260924 17:37:23.641114 25625 consensus_queue.cc:260] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.641403 25625 ts_tablet_manager.cc:1428] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:37:23.641417 25342 heartbeater.cc:503] Master 127.6.37.62:37065 was elected leader, sending a full tablet report...
I20260924 17:37:23.641418 25626 raft_consensus.cc:348] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.641569 25626 raft_consensus.cc:374] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:23.641602 25626 raft_consensus.cc:729] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7afab51738fc4a79a7a4e2a14201d1f3, State: Initialized, Role: FOLLOWER
I20260924 17:37:23.641729 25626 consensus_queue.cc:260] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.641970 25626 ts_tablet_manager.cc:1428] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:37:23.642091 25476 heartbeater.cc:503] Master 127.6.37.62:37065 was elected leader, sending a full tablet report...
I20260924 17:37:23.642324 25627 raft_consensus.cc:348] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.642501 25627 raft_consensus.cc:374] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:23.642547 25627 raft_consensus.cc:729] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28c8445a16804da9821fe3e8b1108bc7, State: Initialized, Role: FOLLOWER
I20260924 17:37:23.642689 25627 consensus_queue.cc:260] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.642978 25627 ts_tablet_manager.cc:1428] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260924 17:37:23.643007 25610 heartbeater.cc:503] Master 127.6.37.62:37065 was elected leader, sending a full tablet report...
W20260924 17:37:23.715670 25477 tablet.cc:2369] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:23.733614 25632 raft_consensus.cc:482] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:23.733737 25632 raft_consensus.cc:504] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.734179 25632 leader_election.cc:288] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7afab51738fc4a79a7a4e2a14201d1f3 (127.6.37.2:44039), 28c8445a16804da9821fe3e8b1108bc7 (127.6.37.3:46327)
I20260924 17:37:23.737056 25623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.734449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:60871 (local address 127.6.37.2:44039)
0924 17:37:23.734493 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.734496 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.734508 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:37:23.734589 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.734591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.734601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.734670 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:23.734856 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.735358 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.736326 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.736696 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.736781 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.736792 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.736942 (+ 150us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.736992 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:37:23.737056 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.734371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:44039 (local address 127.6.37.1:60871)
0924 17:37:23.734441 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.734454 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.734513 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.734690 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.734691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.734693 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:23.734768 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.734770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.735447 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.735448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.736226 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.736228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.736793 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.736794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.736864 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.736867 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.736934 (+ 67us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.736979 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":29}
I20260924 17:37:23.737157 25622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.734449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:60869 (local address 127.6.37.3:46327)
0924 17:37:23.734506 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.734508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.734665 (+ 157us) server_negotiation.cc:407] Connection header received
0924 17:37:23.734741 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.734742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.734752 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.734826 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:23.735016 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.735468 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.736406 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.736771 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.736851 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.736859 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.737024 (+ 165us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.737062 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:37:23.737196 25635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.734371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:46327 (local address 127.6.37.1:60869)
0924 17:37:23.734590 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.734599 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:23.734683 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:23.734832 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:23.734833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:23.734834 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:23.734926 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.734930 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.735560 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.735561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.736315 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:23.736317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.736855 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.736856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:23.736932 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.736935 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:23.737016 (+ 81us) client_negotiation.cc:240] Negotiation successful
0924 17:37:23.737054 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":27,"thread_start_us":102,"threads_started":1}
I20260924 17:37:23.737425 25430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56cad2d65d134acab3095edf0fddc397" candidate_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" is_pre_election: true
I20260924 17:37:23.737519 25563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56cad2d65d134acab3095edf0fddc397" candidate_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c8445a16804da9821fe3e8b1108bc7" is_pre_election: true
I20260924 17:37:23.737612 25430 raft_consensus.cc:2454] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c313fa3d8ae45bbacf7dc6af7a4c0dc in term 0.
I20260924 17:37:23.737636 25563 raft_consensus.cc:2454] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c313fa3d8ae45bbacf7dc6af7a4c0dc in term 0.
I20260924 17:37:23.737856 25228 leader_election.cc:302] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c313fa3d8ae45bbacf7dc6af7a4c0dc, 7afab51738fc4a79a7a4e2a14201d1f3; no voters:
I20260924 17:37:23.738013 25632 raft_consensus.cc:2781] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:37:23.738076 25632 raft_consensus.cc:482] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:37:23.738094 25632 raft_consensus.cc:3037] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:23.738840 25632 raft_consensus.cc:504] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.739060 25632 leader_election.cc:288] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [CANDIDATE]: Term 1 election: Requested vote from peers 7afab51738fc4a79a7a4e2a14201d1f3 (127.6.37.2:44039), 28c8445a16804da9821fe3e8b1108bc7 (127.6.37.3:46327)
I20260924 17:37:23.739228 25563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56cad2d65d134acab3095edf0fddc397" candidate_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c8445a16804da9821fe3e8b1108bc7"
I20260924 17:37:23.739262 25430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56cad2d65d134acab3095edf0fddc397" candidate_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7afab51738fc4a79a7a4e2a14201d1f3"
I20260924 17:37:23.739310 25563 raft_consensus.cc:3037] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:23.739372 25430 raft_consensus.cc:3037] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:23.740044 25563 raft_consensus.cc:2454] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c313fa3d8ae45bbacf7dc6af7a4c0dc in term 1.
I20260924 17:37:23.740139 25430 raft_consensus.cc:2454] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c313fa3d8ae45bbacf7dc6af7a4c0dc in term 1.
I20260924 17:37:23.740242 25230 leader_election.cc:302] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c313fa3d8ae45bbacf7dc6af7a4c0dc, 28c8445a16804da9821fe3e8b1108bc7; no voters:
I20260924 17:37:23.740332 25632 raft_consensus.cc:2781] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:23.740489 25632 raft_consensus.cc:686] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [term 1 LEADER]: Becoming Leader. State: Replica: 0c313fa3d8ae45bbacf7dc6af7a4c0dc, State: Running, Role: LEADER
I20260924 17:37:23.740589 25632 consensus_queue.cc:237] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } }
I20260924 17:37:23.741401 25151 catalog_manager.cc:5495] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c313fa3d8ae45bbacf7dc6af7a4c0dc (127.6.37.1). New cstate: current_term: 1 leader_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c313fa3d8ae45bbacf7dc6af7a4c0dc" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 } health_report { overall_health: UNKNOWN } } }
I20260924 17:37:23.749125 25624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.746869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37340 (local address 127.6.37.1:36309)
0924 17:37:23.746957 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:23.746959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:23.746975 (+ 16us) server_negotiation.cc:407] Connection header received
0924 17:37:23.747004 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:23.747004 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:23.747021 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:23.747082 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:23.747233 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.747722 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.748495 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:23.748680 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:23.748733 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:23.748851 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:23.748935 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:23.749007 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:23.749049 (+ 42us) server_negotiation.cc:299] Negotiation successful
0924 17:37:23.749058 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260924 17:37:23.750803 25430 raft_consensus.cc:1261] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 1 FOLLOWER]: Refusing update from remote peer 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:23.750818 25563 raft_consensus.cc:1261] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 1 FOLLOWER]: Refusing update from remote peer 0c313fa3d8ae45bbacf7dc6af7a4c0dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:23.751230 25632 consensus_queue.cc:1035] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7afab51738fc4a79a7a4e2a14201d1f3" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 44039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:23.751389 25636 consensus_queue.cc:1035] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "28c8445a16804da9821fe3e8b1108bc7" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 46327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:23.754132 25639 mvcc.cc:205] Tried to move back new op lower bound from 7332951833600778240 to 7332951833562030080. Current Snapshot: MvccSnapshot[applied={T|T < 7332951833600778240}]
I20260924 17:37:23.754252 25641 mvcc.cc:205] Tried to move back new op lower bound from 7332951833600778240 to 7332951833562030080. Current Snapshot: MvccSnapshot[applied={T|T < 7332951833600778240 or (T in {7332951833600778240})}]
I20260924 17:37:23.756459 25151 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:23.756536 25151 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:23.757264 25151 catalog_manager.cc:5782] T 00000000000000000000000000000000 P af364f8a3f8842e59e85e525100f7bee: Sending DeleteTablet for 3 replicas of tablet 56cad2d65d134acab3095edf0fddc397
I20260924 17:37:23.757645 25276 tablet_service.cc:1514] Processing DeleteTablet for tablet 56cad2d65d134acab3095edf0fddc397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:23 UTC) from {username='slave'} at 127.0.0.1:37338
I20260924 17:37:23.757673 25542 tablet_service.cc:1514] Processing DeleteTablet for tablet 56cad2d65d134acab3095edf0fddc397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:23 UTC) from {username='slave'} at 127.0.0.1:34386
I20260924 17:37:23.757877 25649 tablet_replica.cc:330] T 56cad2d65d134acab3095edf0fddc397 P 0c313fa3d8ae45bbacf7dc6af7a4c0dc: stopping tablet replica
I20260924 17:37:23.757869 25409 tablet_service.cc:1514] Processing DeleteTablet for tablet 56cad2d65d134acab3095edf0fddc397 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:23 UTC) from {username='slave'} at 127.0.0.1:49264
I20260924 17:37:23.757903 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25212
I20260924 17:37:23.758008 25650 tablet_replica.cc:330] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: stopping tablet replica
I20260924 17:37:23.758693 25650 raft_consensus.cc:2229] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:23.758827 25650 raft_consensus.cc:2258] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:23.759254 25650 ts_tablet_manager.cc:1905] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:23.761133 25650 ts_tablet_manager.cc:1918] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:23.761217 25650 log.cc:1196] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/56cad2d65d134acab3095edf0fddc397
I20260924 17:37:23.761444 25650 ts_tablet_manager.cc:1939] T 56cad2d65d134acab3095edf0fddc397 P 28c8445a16804da9821fe3e8b1108bc7: Deleting consensus metadata
I20260924 17:37:23.761857 25138 catalog_manager.cc:4841] TS 28c8445a16804da9821fe3e8b1108bc7 (127.6.37.3:46327): tablet 56cad2d65d134acab3095edf0fddc397 (table test-table [id=bcbfa1581f7b43a4b904088e991e7275]) successfully deleted
I20260924 17:37:23.763007 25651 tablet_replica.cc:330] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: stopping tablet replica
I20260924 17:37:23.763123 25651 raft_consensus.cc:2229] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:23.763252 25651 raft_consensus.cc:2258] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:23.763644 25651 ts_tablet_manager.cc:1905] T 56cad2d65d134acab3095edf0fddc397 P 7afab51738fc4a79a7a4e2a14201d1f3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260924 17:37:23.764601 25135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:36309 (error 108)
I20260924 17:37:23.764868 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25345
I20260924 17:37:23.765061 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.764935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36309 (local address 127.0.0.1:37356)
0924 17:37:23.764985 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.765024 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:36309: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260924 17:37:23.765722 25135 catalog_manager.cc:4584] TS 0c313fa3d8ae45bbacf7dc6af7a4c0dc (127.6.37.1:36309): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 56cad2d65d134acab3095edf0fddc397: Network error: Client connection negotiation failed: client connection to 127.6.37.1:36309: connect: Connection refused (error 111)
I20260924 17:37:23.770486 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25479
I20260924 17:37:23.770512 25620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:23.770396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:44039 (local address 127.0.0.1:49280)
0924 17:37:23.770448 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:23.770481 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.2:44039: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260924 17:37:23.775360 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25120
2026-09-24T17:37:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (771 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:23 dist-test-slave-gcz9 krb5kdc[25655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:23 dist-test-slave-gcz9 krb5kdc[25655](info): set up 2 sockets
Sep 24 17:37:23 dist-test-slave-gcz9 krb5kdc[25655](info): commencing operation
krb5kdc: starting...
W20260924 17:37:24.808414 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:24 dist-test-slave-gcz9 krb5kdc[25655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:24.921329 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38171
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:38171
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:25.001703 25668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:25.001959 25668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:25.002008 25668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:25.003273 25668 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:25.003345 25668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:25.003368 25668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:25.003389 25668 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:25.003424 25668 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:25.005402 25668 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:38171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:38171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:25.005703 25668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:25.005941 25668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:25.010842 25676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.010910 25674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.010910 25673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.011219 25668 server_base.cc:1034] running on GCE node
I20260924 17:37:25.011543 25668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:25.011833 25668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:25.013010 25668 hybrid_clock.cc:648] HybridClock initialized: now 1790271445012995 us; error 30 us; skew 500 ppm
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:25.015488 25668 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:25.015933 25668 webserver.cc:460] Webserver started at http://127.6.37.62:42805/ using document root <none> and password file <none>
I20260924 17:37:25.016125 25668 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:25.016165 25668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:25.016254 25668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:25.017241 25668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "7ecac8836e024f38b984dae2c252e694"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "9bf99cb955eae60cacc2a7166056bcb0"
server_key_iv: "ff460f3cc75ec65666a344e3f1d42f55"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.017560 25668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "7ecac8836e024f38b984dae2c252e694"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "9bf99cb955eae60cacc2a7166056bcb0"
server_key_iv: "ff460f3cc75ec65666a344e3f1d42f55"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.018786 25668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260924 17:37:25.019518 25683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.019681 25668 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.019769 25668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "7ecac8836e024f38b984dae2c252e694"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "9bf99cb955eae60cacc2a7166056bcb0"
server_key_iv: "ff460f3cc75ec65666a344e3f1d42f55"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.019838 25668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:25.029079 25668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:25.030849 25668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:25.031059 25668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:25.034829 25668 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:38171
I20260924 17:37:25.034904 25737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:38171 every 8 connection(s)
I20260924 17:37:25.035296 25668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:25.035787 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25668
I20260924 17:37:25.035920 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:25.036123 6292 external_mini_cluster.cc:1428] Setting key b1d3b6937fc0cc2686e88d3c4a7c969a
I20260924 17:37:25.036334 25738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:25.039773 25738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: Bootstrap starting.
I20260924 17:37:25.040482 25738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:25.040776 25738 log.cc:824] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:25.041532 25738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: No bootstrap required, opened a new log
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:25.043761 25738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecac8836e024f38b984dae2c252e694" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38171 } }
I20260924 17:37:25.043952 25738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:25.044019 25738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ecac8836e024f38b984dae2c252e694, State: Initialized, Role: FOLLOWER
I20260924 17:37:25.044159 25738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecac8836e024f38b984dae2c252e694" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38171 } }
I20260924 17:37:25.044247 25738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:25.044293 25738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:25.044348 25738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:25.045100 25738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecac8836e024f38b984dae2c252e694" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38171 } }
I20260924 17:37:25.045230 25738 leader_election.cc:302] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ecac8836e024f38b984dae2c252e694; no voters:
I20260924 17:37:25.045439 25738 leader_election.cc:288] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:25.045475 25743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:25.045591 25743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [term 1 LEADER]: Becoming Leader. State: Replica: 7ecac8836e024f38b984dae2c252e694, State: Running, Role: LEADER
I20260924 17:37:25.045673 25743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecac8836e024f38b984dae2c252e694" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38171 } }
I20260924 17:37:25.045735 25738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:25.046023 25743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ecac8836e024f38b984dae2c252e694. Latest consensus state: current_term: 1 leader_uuid: "7ecac8836e024f38b984dae2c252e694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecac8836e024f38b984dae2c252e694" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38171 } } }
I20260924 17:37:25.046108 25743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:25.046036 25745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ecac8836e024f38b984dae2c252e694" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ecac8836e024f38b984dae2c252e694" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 38171 } } }
I20260924 17:37:25.046267 25745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694 [sys.catalog]: This master's current role is: LEADER
W20260924 17:37:25.047658 25758 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:25.047714 25758 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:25.047864 25748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:25.048061 25748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:25.048210 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.036977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37794 (local address 127.6.37.62:38171)
0924 17:37:25.037190 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.037200 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.037234 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:37:25.037919 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.037928 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.037998 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.038157 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.038755 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.040168 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.040981 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.041547 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.041666 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.044113 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.044118 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.044118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:25.044130 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.046278 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.046636 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.046638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.046639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.046714 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.046968 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.046970 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.046970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.047316 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.047487 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.047612 (+ 125us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.047957 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260924 17:37:25.049803 25748 catalog_manager.cc:1347] Generated new cluster ID: c8b67147aee94ed59245cb2b4b610069
I20260924 17:37:25.049854 25748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:25.064392 25748 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:25.064915 25748 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:25.069099 25748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: Generated new TSK 0
I20260924 17:37:25.069270 25748 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.6.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
Entry for principal kudu/127.6.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab.
I20260924 17:37:25.103839 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38171
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:25.185487 25764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:25.185726 25764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:25.185763 25764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:25.187016 25764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:25.187085 25764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:25.187130 25764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:25.188603 25764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.1.keytab
--principal=kudu/127.6.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:25.188894 25764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:25.189123 25764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:25.194439 25769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.194541 25764 server_base.cc:1034] running on GCE node
W20260924 17:37:25.194440 25772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.194576 25770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.194985 25764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:25.195248 25764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:25.196390 25764 hybrid_clock.cc:648] HybridClock initialized: now 1790271445196373 us; error 42 us; skew 500 ppm
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:25.198822 25764 init.cc:377] Logged in from keytab as kudu/127.6.37.1@KRBTEST.COM (short username kudu)
I20260924 17:37:25.199314 25764 webserver.cc:460] Webserver started at http://127.6.37.1:46433/ using document root <none> and password file <none>
I20260924 17:37:25.199551 25764 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:25.199596 25764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:25.199793 25764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:25.200942 25764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "a7ccbf3b921f46038e6929046654499e"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "3c878775e6aa2db0d408537dced64609"
server_key_iv: "98c7b61b819d838ca84fc0d6885f971e"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.201499 25764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "a7ccbf3b921f46038e6929046654499e"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "3c878775e6aa2db0d408537dced64609"
server_key_iv: "98c7b61b819d838ca84fc0d6885f971e"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.202984 25764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260924 17:37:25.203760 25779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.203939 25764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:25.204052 25764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "a7ccbf3b921f46038e6929046654499e"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "3c878775e6aa2db0d408537dced64609"
server_key_iv: "98c7b61b819d838ca84fc0d6885f971e"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.204133 25764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:25.224858 25764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:25.226775 25764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:25.227002 25764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:25.227267 25764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:25.227639 25764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:25.227701 25764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.227752 25764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:25.227797 25764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.234447 25764 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:36865
I20260924 17:37:25.234529 25895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:36865 every 8 connection(s)
I20260924 17:37:25.234918 25764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:25.239066 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25764
I20260924 17:37:25.239154 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:37:25.239385 6292 external_mini_cluster.cc:1428] Setting key 16adad5fcc80079afe227957e4fc6c23
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.1@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:25.244963 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.235693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:34195 (local address 127.6.37.62:38171)
0924 17:37:25.235740 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.235743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.235975 (+ 232us) server_negotiation.cc:407] Connection header received
0924 17:37:25.236490 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.236491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.236503 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.236551 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.237548 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.238054 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.239213 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.239526 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.239597 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.241913 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.241915 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.241915 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:25.241923 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.243376 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.243940 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.243941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.243942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.244000 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.244298 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.244299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.244299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.244403 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.244453 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.244815 (+ 362us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.244885 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:25.245301 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.235682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38171 (local address 127.6.37.1:34195)
0924 17:37:25.235840 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.235879 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.236398 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.236624 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.236627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.237226 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:25.237464 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.237469 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.238169 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.238170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.239096 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.239098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.239628 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.239630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.239828 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.240413 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:25.240422 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:25.241808 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:25.243488 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:25.243496 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:25.243499 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:25.243853 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:25.244066 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:25.244067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:25.244068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:25.244228 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:25.244472 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:25.244480 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:25.244666 (+ 186us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.244798 (+ 132us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.245014 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260924 17:37:25.245936 25896 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38171
I20260924 17:37:25.246062 25896 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:25.246274 25896 heartbeater.cc:511] Master 127.6.37.62:38171 requested a full tablet report, sending...
I20260924 17:37:25.246912 25701 ts_manager.cc:194] Registered new tserver with Master: a7ccbf3b921f46038e6929046654499e (127.6.37.1:36865)
I20260924 17:37:25.247912 25701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.1@KRBTEST.COM'} at 127.6.37.1:34195
WARNING: no policy specified for kudu/127.6.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
Entry for principal kudu/127.6.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab.
I20260924 17:37:25.265981 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38171
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:25.346853 25901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:25.347100 25901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:25.347139 25901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:25.348341 25901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:25.348407 25901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:25.348450 25901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:25.349941 25901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.2.keytab
--principal=kudu/127.6.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:25.350208 25901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:25.350440 25901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:37:25.355494 25901 server_base.cc:1034] running on GCE node
W20260924 17:37:25.355299 25907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.355297 25906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.355326 25909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.355865 25901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:25.356108 25901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:25.357288 25901 hybrid_clock.cc:648] HybridClock initialized: now 1790271445357277 us; error 42 us; skew 500 ppm
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:25.359694 25901 init.cc:377] Logged in from keytab as kudu/127.6.37.2@KRBTEST.COM (short username kudu)
I20260924 17:37:25.360162 25901 webserver.cc:460] Webserver started at http://127.6.37.2:36667/ using document root <none> and password file <none>
I20260924 17:37:25.360406 25901 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:25.360476 25901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:25.360627 25901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:25.361636 25901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "1ed49835abac44dfad0977824eb8c403"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "12f8e0a449c50fdf9afe185cc5881a88"
server_key_iv: "afd135ef13b6c77a9f52031b1a90adaa"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.362023 25901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "1ed49835abac44dfad0977824eb8c403"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "12f8e0a449c50fdf9afe185cc5881a88"
server_key_iv: "afd135ef13b6c77a9f52031b1a90adaa"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.363376 25901 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:25.364056 25916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.364226 25901 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:25.364323 25901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "1ed49835abac44dfad0977824eb8c403"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "12f8e0a449c50fdf9afe185cc5881a88"
server_key_iv: "afd135ef13b6c77a9f52031b1a90adaa"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.364403 25901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:25.372514 25901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:25.374341 25901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:25.374504 25901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:25.374715 25901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:25.375106 25901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:25.375159 25901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.375192 25901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:25.375218 25901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.380864 25901 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:40429
I20260924 17:37:25.380914 26031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:40429 every 8 connection(s)
I20260924 17:37:25.381201 25901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.2@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:25.389730 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.381886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:49847 (local address 127.6.37.62:38171)
0924 17:37:25.381948 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.381950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.382143 (+ 193us) server_negotiation.cc:407] Connection header received
0924 17:37:25.382618 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.382619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.382629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.382683 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.383587 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.384081 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.385029 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.385208 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.385257 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.387259 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.387261 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.387261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:25.387268 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.388636 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.388969 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.388970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.388970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.389020 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.389222 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.389223 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.389223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.389318 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.389366 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.389603 (+ 237us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.389668 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260924 17:37:25.389940 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.381857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38171 (local address 127.6.37.2:49847)
0924 17:37:25.382021 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.382060 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.382537 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.382733 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.382736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.383311 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:25.383511 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.383516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.384160 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.384161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.384953 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.384955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.385281 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.385282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.385381 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.385841 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:25.385851 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:25.387176 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:25.388703 (+ 1527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:25.388709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:25.388710 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:25.388908 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:25.389078 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:25.389078 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:25.389079 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:25.389170 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:25.389372 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:25.389376 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:25.389489 (+ 113us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.389577 (+ 88us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.389693 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":103,"threads_started":1}
I20260924 17:37:25.390498 26032 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38171
I20260924 17:37:25.390594 26032 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:25.390619 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 25901
I20260924 17:37:25.390743 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:37:25.390779 26032 heartbeater.cc:511] Master 127.6.37.62:38171 requested a full tablet report, sending...
I20260924 17:37:25.391010 6292 external_mini_cluster.cc:1428] Setting key 38d2ca8e63ef25f5b0d43276efa230a2
I20260924 17:37:25.391338 25701 ts_manager.cc:194] Registered new tserver with Master: 1ed49835abac44dfad0977824eb8c403 (127.6.37.2:40429)
I20260924 17:37:25.391785 25701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.2@KRBTEST.COM'} at 127.6.37.2:49847
WARNING: no policy specified for kudu/127.6.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
Entry for principal kudu/127.6.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab.
I20260924 17:37:25.415555 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38171
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:25.496734 26037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:25.496923 26037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:25.496953 26037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:25.498095 26037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:25.498136 26037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:25.498190 26037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:25.499639 26037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.3.keytab
--principal=kudu/127.6.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:38171
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:25.499884 26037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:25.500125 26037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:25.505039 26042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.505129 26043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.505039 26045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.505257 26037 server_base.cc:1034] running on GCE node
I20260924 17:37:25.505527 26037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:25.505723 26037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:25.506862 26037 hybrid_clock.cc:648] HybridClock initialized: now 1790271445506848 us; error 28 us; skew 500 ppm
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:25.509399 26037 init.cc:377] Logged in from keytab as kudu/127.6.37.3@KRBTEST.COM (short username kudu)
I20260924 17:37:25.509827 26037 webserver.cc:460] Webserver started at http://127.6.37.3:36227/ using document root <none> and password file <none>
I20260924 17:37:25.510069 26037 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:25.510131 26037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:25.510280 26037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:25.511355 26037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "a26eaecd5eb24e10811fe7d97f978910"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "dd6c75241bdb55236ac0a457de5db94a"
server_key_iv: "3e0c04e4414cb3c4995023ae4127649f"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.511706 26037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "a26eaecd5eb24e10811fe7d97f978910"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "dd6c75241bdb55236ac0a457de5db94a"
server_key_iv: "3e0c04e4414cb3c4995023ae4127649f"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.513013 26037 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:25.513708 26052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.513902 26037 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:25.514006 26037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "a26eaecd5eb24e10811fe7d97f978910"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "dd6c75241bdb55236ac0a457de5db94a"
server_key_iv: "3e0c04e4414cb3c4995023ae4127649f"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.514078 26037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:25.522575 26037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:25.525700 26037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:25.525858 26037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:25.526106 26037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:25.526422 26037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:25.526476 26037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.526518 26037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:25.526546 26037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.533958 26037 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:39257
I20260924 17:37:25.534031 26168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:39257 every 8 connection(s)
I20260924 17:37:25.534394 26037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:37:25.540560 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26037
I20260924 17:37:25.540688 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:37:25.540925 6292 external_mini_cluster.cc:1428] Setting key f7465f0e31f17f0940ea8e7df4779360
Sep 24 17:37:25 dist-test-slave-gcz9 krb5kdc[25655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271445, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.3@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:25.548923 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.539270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:43665 (local address 127.6.37.62:38171)
0924 17:37:25.539316 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.539318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.539574 (+ 256us) server_negotiation.cc:407] Connection header received
0924 17:37:25.540080 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.540082 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.540097 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.540175 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.541374 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.542056 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.543099 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.543476 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.543569 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.545718 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.545720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.545720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:25.545729 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.547502 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.547905 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.547907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.547908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.547983 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.548248 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.548249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.548249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.548375 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.548452 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.548749 (+ 297us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.548832 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:25.549111 26171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.539258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:38171 (local address 127.6.37.3:43665)
0924 17:37:25.539458 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.539496 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.539982 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.540229 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.540232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.540914 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:25.541242 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.541254 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.542149 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.542150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.543021 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.543023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.543563 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.543564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.543668 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.544214 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:25.544223 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:25.545618 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:25.547584 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:25.547590 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:25.547592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:25.547806 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:25.548062 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:25.548063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:25.548063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:25.548179 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:25.548463 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:25.548471 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:25.548610 (+ 139us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.548714 (+ 104us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.548878 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
I20260924 17:37:25.549623 26169 heartbeater.cc:347] Connected to a master server at 127.6.37.62:38171
I20260924 17:37:25.549741 26169 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:25.549954 26169 heartbeater.cc:511] Master 127.6.37.62:38171 requested a full tablet report, sending...
I20260924 17:37:25.550379 25701 ts_manager.cc:194] Registered new tserver with Master: a26eaecd5eb24e10811fe7d97f978910 (127.6.37.3:39257)
I20260924 17:37:25.550977 25701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.6.37.3@KRBTEST.COM'} at 127.6.37.3:43665
I20260924 17:37:25.552727 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:37:25.561811 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.554403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.6.37.62:38171)
0924 17:37:25.554475 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.554477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.554601 (+ 124us) server_negotiation.cc:407] Connection header received
0924 17:37:25.554672 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.554672 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.554681 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.554725 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.555553 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.556028 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.557290 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.557596 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.557652 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.559210 (+ 1558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.559211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.559212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:25.559218 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.560653 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.561080 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.561080 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.561081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.561131 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:25.561331 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:25.561332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:25.561332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:25.561469 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.561543 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.561689 (+ 146us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.561746 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260924 17:37:25.563772 25701 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37800:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:37:25.565352 25701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:37:25.572389 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.567795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42852 (local address 127.6.37.1:36865)
0924 17:37:25.567968 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.567973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.568540 (+ 567us) server_negotiation.cc:407] Connection header received
0924 17:37:25.568661 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.568664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.568681 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.568729 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:25.568928 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.569725 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.571174 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.571912 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.571962 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.572020 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.572268 (+ 248us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.572307 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260924 17:37:25.572669 26182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.567543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36865 (local address 127.0.0.1:42852)
0924 17:37:25.568122 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.568165 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.568569 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.568821 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.568822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.568823 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:25.568858 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.568859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.569823 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.569824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.571069 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.571073 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.572079 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.572080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.572163 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.572175 (+ 12us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.572518 (+ 343us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.572595 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":65,"threads_started":1}
I20260924 17:37:25.573560 26179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.567543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:39257 (local address 127.0.0.1:58090)
0924 17:37:25.568123 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.568171 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.568242 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.568532 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.568535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.568538 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:25.568609 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.568612 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.570181 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.570182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.571568 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.571572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.573074 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.573075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.573156 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.573161 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.573318 (+ 157us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.573433 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"mutex_wait_us":3,"thread_start_us":504,"threads_started":1}
I20260924 17:37:25.573515 25828 tablet_service.cc:1467] Processing CreateTablet for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 (DEFAULT_TABLE table=test-table [id=46cc0ad451fb44778397b8c037d473a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:25.573864 25828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:25.574064 26181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.567815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58090 (local address 127.6.37.3:39257)
0924 17:37:25.568233 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.568238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.568250 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:37:25.568340 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.568343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.568361 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.568436 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:25.568699 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.570044 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.571678 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.572885 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.572961 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.573034 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.573836 (+ 802us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.573892 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":101,"threads_started":1}
I20260924 17:37:25.574780 26102 tablet_service.cc:1467] Processing CreateTablet for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 (DEFAULT_TABLE table=test-table [id=46cc0ad451fb44778397b8c037d473a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:25.575169 26102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:25.575774 26178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.567548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40429 (local address 127.0.0.1:33788)
0924 17:37:25.568349 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.568359 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.568397 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.571258 (+ 2861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.571259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.571260 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:25.571303 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.571304 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.572930 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.572931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.574086 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.574089 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.575249 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.575250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.575311 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.575316 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.575653 (+ 337us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.575697 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"thread_start_us":82,"threads_started":1}
I20260924 17:37:25.576136 26183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.568029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.6.37.2:40429)
0924 17:37:25.571026 (+ 2997us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.571032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.571043 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:37:25.571081 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.571083 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.571099 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.571176 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:25.571377 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.572367 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.574264 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.575068 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.575135 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.575188 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.576008 (+ 820us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.576059 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2954,"thread_start_us":73,"threads_started":1}
I20260924 17:37:25.576763 25965 tablet_service.cc:1467] Processing CreateTablet for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 (DEFAULT_TABLE table=test-table [id=46cc0ad451fb44778397b8c037d473a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:25.577112 25965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:25.577819 26184 tablet_bootstrap.cc:492] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: Bootstrap starting.
I20260924 17:37:25.578862 26184 tablet_bootstrap.cc:654] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:25.579206 26184 log.cc:824] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:25.580057 26184 tablet_bootstrap.cc:492] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: No bootstrap required, opened a new log
I20260924 17:37:25.580121 26184 ts_tablet_manager.cc:1397] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:25.580492 26187 tablet_bootstrap.cc:492] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: Bootstrap starting.
I20260924 17:37:25.581310 26187 tablet_bootstrap.cc:654] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:25.581811 26184 raft_consensus.cc:348] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.581936 26187 log.cc:824] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:25.581980 26184 raft_consensus.cc:374] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:25.582026 26184 raft_consensus.cc:729] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ccbf3b921f46038e6929046654499e, State: Initialized, Role: FOLLOWER
I20260924 17:37:25.582154 26184 consensus_queue.cc:260] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.582469 26184 ts_tablet_manager.cc:1428] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260924 17:37:25.582602 25896 heartbeater.cc:503] Master 127.6.37.62:38171 was elected leader, sending a full tablet report...
I20260924 17:37:25.582784 26187 tablet_bootstrap.cc:492] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: No bootstrap required, opened a new log
I20260924 17:37:25.582855 26187 ts_tablet_manager.cc:1397] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:25.585390 26187 raft_consensus.cc:348] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.585595 26187 raft_consensus.cc:374] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:25.585636 26187 raft_consensus.cc:729] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ed49835abac44dfad0977824eb8c403, State: Initialized, Role: FOLLOWER
I20260924 17:37:25.585791 26187 consensus_queue.cc:260] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.586113 26032 heartbeater.cc:503] Master 127.6.37.62:38171 was elected leader, sending a full tablet report...
I20260924 17:37:25.586130 26187 ts_tablet_manager.cc:1428] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260924 17:37:25.587073 26185 tablet_bootstrap.cc:492] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Bootstrap starting.
I20260924 17:37:25.587671 26185 tablet_bootstrap.cc:654] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:25.588143 26185 log.cc:824] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:25.588857 26185 tablet_bootstrap.cc:492] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: No bootstrap required, opened a new log
I20260924 17:37:25.588910 26185 ts_tablet_manager.cc:1397] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:25.590536 26185 raft_consensus.cc:348] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.590665 26185 raft_consensus.cc:374] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:25.590687 26185 raft_consensus.cc:729] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26eaecd5eb24e10811fe7d97f978910, State: Initialized, Role: FOLLOWER
I20260924 17:37:25.590826 26185 consensus_queue.cc:260] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.591187 26185 ts_tablet_manager.cc:1428] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260924 17:37:25.591219 26169 heartbeater.cc:503] Master 127.6.37.62:38171 was elected leader, sending a full tablet report...
I20260924 17:37:25.617389 26190 raft_consensus.cc:482] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:25.617499 26190 raft_consensus.cc:504] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.617916 26190 leader_election.cc:288] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26eaecd5eb24e10811fe7d97f978910 (127.6.37.3:39257), a7ccbf3b921f46038e6929046654499e (127.6.37.1:36865)
I20260924 17:37:25.620834 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.618121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:55429 (local address 127.6.37.1:36865)
0924 17:37:25.618185 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.618187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.618326 (+ 139us) server_negotiation.cc:407] Connection header received
0924 17:37:25.618395 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.618397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.618409 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.618491 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:25.618644 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.619163 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.620102 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.620474 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.620557 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.620568 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.620724 (+ 156us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.620764 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260924 17:37:25.620841 26181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.618121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:34799 (local address 127.6.37.3:39257)
0924 17:37:25.618175 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.618177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.618292 (+ 115us) server_negotiation.cc:407] Connection header received
0924 17:37:25.618369 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.618370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.618382 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.618446 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:25.618613 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.619148 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.620082 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.620451 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.620567 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.620577 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.620732 (+ 155us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.620772 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260924 17:37:25.620850 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.618076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:39257 (local address 127.6.37.2:34799)
0924 17:37:25.618216 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.618234 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.618304 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.618448 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.618449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.618450 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:25.618534 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.618535 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.619227 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.619229 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.619985 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.619987 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.620567 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.620568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.620651 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.620656 (+ 5us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.620726 (+ 70us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.620772 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":1}
I20260924 17:37:25.620859 26193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.618076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36865 (local address 127.6.37.2:55429)
0924 17:37:25.618248 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.618266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.618340 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.618497 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.618498 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.618500 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:25.618570 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.618576 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.619244 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.619245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.620000 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.620002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.620557 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.620558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.620636 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.620645 (+ 9us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.620717 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.620761 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":16,"thread_start_us":96,"threads_started":1}
I20260924 17:37:25.621304 26122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ca50e7701c4a0f99d5cf7ceb9d5d36" candidate_uuid: "1ed49835abac44dfad0977824eb8c403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26eaecd5eb24e10811fe7d97f978910" is_pre_election: true
I20260924 17:37:25.621356 25849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ca50e7701c4a0f99d5cf7ceb9d5d36" candidate_uuid: "1ed49835abac44dfad0977824eb8c403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ccbf3b921f46038e6929046654499e" is_pre_election: true
I20260924 17:37:25.621464 26122 raft_consensus.cc:2454] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ed49835abac44dfad0977824eb8c403 in term 0.
I20260924 17:37:25.621541 25849 raft_consensus.cc:2454] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ed49835abac44dfad0977824eb8c403 in term 0.
I20260924 17:37:25.621718 25917 leader_election.cc:302] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ed49835abac44dfad0977824eb8c403, a26eaecd5eb24e10811fe7d97f978910; no voters:
I20260924 17:37:25.621917 26190 raft_consensus.cc:2781] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:37:25.621958 26190 raft_consensus.cc:482] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:37:25.621974 26190 raft_consensus.cc:3037] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:25.622645 26190 raft_consensus.cc:504] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.622787 26190 leader_election.cc:288] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [CANDIDATE]: Term 1 election: Requested vote from peers a26eaecd5eb24e10811fe7d97f978910 (127.6.37.3:39257), a7ccbf3b921f46038e6929046654499e (127.6.37.1:36865)
I20260924 17:37:25.622963 26122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ca50e7701c4a0f99d5cf7ceb9d5d36" candidate_uuid: "1ed49835abac44dfad0977824eb8c403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26eaecd5eb24e10811fe7d97f978910"
I20260924 17:37:25.622984 25849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ca50e7701c4a0f99d5cf7ceb9d5d36" candidate_uuid: "1ed49835abac44dfad0977824eb8c403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7ccbf3b921f46038e6929046654499e"
I20260924 17:37:25.623050 26122 raft_consensus.cc:3037] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:25.623050 25849 raft_consensus.cc:3037] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:25.623960 26122 raft_consensus.cc:2454] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ed49835abac44dfad0977824eb8c403 in term 1.
I20260924 17:37:25.623967 25849 raft_consensus.cc:2454] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ed49835abac44dfad0977824eb8c403 in term 1.
I20260924 17:37:25.624116 25917 leader_election.cc:302] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ed49835abac44dfad0977824eb8c403, a26eaecd5eb24e10811fe7d97f978910; no voters:
I20260924 17:37:25.624185 26190 raft_consensus.cc:2781] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:25.624342 26190 raft_consensus.cc:686] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [term 1 LEADER]: Becoming Leader. State: Replica: 1ed49835abac44dfad0977824eb8c403, State: Running, Role: LEADER
I20260924 17:37:25.624459 26190 consensus_queue.cc:237] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } }
I20260924 17:37:25.625313 25701 catalog_manager.cc:5495] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ed49835abac44dfad0977824eb8c403 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "1ed49835abac44dfad0977824eb8c403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed49835abac44dfad0977824eb8c403" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 40429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 } health_report { overall_health: UNKNOWN } } }
I20260924 17:37:25.630203 26183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.627883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.6.37.2:40429)
0924 17:37:25.627938 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.627940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.627954 (+ 14us) server_negotiation.cc:407] Connection header received
0924 17:37:25.627988 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.627990 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.628005 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.628076 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:25.628226 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.628676 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.629432 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.629649 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.629724 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.629891 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:25.629999 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:25.630091 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.630110 (+ 19us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.630130 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260924 17:37:25.631676 26033 tablet.cc:2369] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:25.631994 25849 raft_consensus.cc:1261] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e [term 1 FOLLOWER]: Refusing update from remote peer 1ed49835abac44dfad0977824eb8c403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:25.631989 26122 raft_consensus.cc:1261] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 1 FOLLOWER]: Refusing update from remote peer 1ed49835abac44dfad0977824eb8c403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:25.632367 26194 consensus_queue.cc:1035] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7ccbf3b921f46038e6929046654499e" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 36865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:25.632520 26190 consensus_queue.cc:1035] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P 1ed49835abac44dfad0977824eb8c403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26eaecd5eb24e10811fe7d97f978910" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 39257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:25.635140 26198 mvcc.cc:205] Tried to move back new op lower bound from 7332951841305804800 to 7332951841278513152. Current Snapshot: MvccSnapshot[applied={T|T < 7332951841305804800}]
I20260924 17:37:25.635970 26197 mvcc.cc:205] Tried to move back new op lower bound from 7332951841305804800 to 7332951841278513152. Current Snapshot: MvccSnapshot[applied={T|T < 7332951841305804800 or (T in {7332951841305804800})}]
I20260924 17:37:25.636958 25700 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:25.637070 25700 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37800:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:25.637825 25700 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ecac8836e024f38b984dae2c252e694: Sending DeleteTablet for 3 replicas of tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36
I20260924 17:37:25.638180 26102 tablet_service.cc:1514] Processing DeleteTablet for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:25 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:58090
I20260924 17:37:25.638195 25828 tablet_service.cc:1514] Processing DeleteTablet for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:25 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:42852
I20260924 17:37:25.638242 25965 tablet_service.cc:1514] Processing DeleteTablet for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:25 UTC) from {username='kudu', principal='kudu/127.6.37.62@KRBTEST.COM'} at 127.0.0.1:33788
I20260924 17:37:25.638403 26209 tablet_replica.cc:330] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a7ccbf3b921f46038e6929046654499e: stopping tablet replica
I20260924 17:37:25.638556 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25764
I20260924 17:37:25.640022 26208 tablet_replica.cc:330] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: stopping tablet replica
I20260924 17:37:25.640139 26208 raft_consensus.cc:2229] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:25.640241 26208 raft_consensus.cc:2258] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:25.640695 26208 ts_tablet_manager.cc:1905] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:25.642740 26208 ts_tablet_manager.cc:1918] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:25.642850 26208 log.cc:1196] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/96ca50e7701c4a0f99d5cf7ceb9d5d36
I20260924 17:37:25.643198 26208 ts_tablet_manager.cc:1939] T 96ca50e7701c4a0f99d5cf7ceb9d5d36 P a26eaecd5eb24e10811fe7d97f978910: Deleting consensus metadata
I20260924 17:37:25.643646 25685 catalog_manager.cc:4841] TS a26eaecd5eb24e10811fe7d97f978910 (127.6.37.3:39257): tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36 (table test-table [id=46cc0ad451fb44778397b8c037d473a8]) successfully deleted
W20260924 17:37:25.644716 25688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:36865 (error 108)
I20260924 17:37:25.645200 26182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.645077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:36865 (local address 127.0.0.1:42854)
0924 17:37:25.645127 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.645162 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:36865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260924 17:37:25.645278 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25901
W20260924 17:37:25.645314 25688 catalog_manager.cc:4584] TS a7ccbf3b921f46038e6929046654499e (127.6.37.1:36865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 96ca50e7701c4a0f99d5cf7ceb9d5d36: Network error: Client connection negotiation failed: client connection to 127.6.37.1:36865: connect: Connection refused (error 111)
I20260924 17:37:25.650658 26182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.650539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:40429 (local address 127.0.0.1:33816)
0924 17:37:25.650599 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.650629 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.2:40429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260924 17:37:25.651019 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26037
I20260924 17:37:25.655802 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 25668
2026-09-24T17:37:25Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1882 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-24T17:37:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:25Z Disabled control of system clock
I20260924 17:37:25.684773 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34259
--webserver_interface=127.6.37.62
--webserver_port=0
--builtin_ntp_servers=127.6.37.20:38401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:25.766829 26215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:25.767055 26215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:25.767076 26215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:25.768245 26215 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:25.768290 26215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:25.768303 26215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:25.768316 26215 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:25.768327 26215 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:25.769691 26215 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34259
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:25.769942 26215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:25.770234 26215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:25.775023 26221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.774989 26220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.775182 26215 server_base.cc:1034] running on GCE node
W20260924 17:37:25.775033 26223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.775473 26215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:25.775715 26215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:25.776851 26215 hybrid_clock.cc:648] HybridClock initialized: now 1790271445776836 us; error 32 us; skew 500 ppm
I20260924 17:37:25.778204 26215 webserver.cc:460] Webserver started at http://127.6.37.62:36175/ using document root <none> and password file <none>
I20260924 17:37:25.778472 26215 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:25.778519 26215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:25.778668 26215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:25.779796 26215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "2418f419b268400298f74e358575d87c"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "dc09da844e8bfcbaa1b64f11f62997d6"
server_key_iv: "6040ba889f567ad57bf5e4444be8740c"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.780177 26215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "2418f419b268400298f74e358575d87c"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "dc09da844e8bfcbaa1b64f11f62997d6"
server_key_iv: "6040ba889f567ad57bf5e4444be8740c"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.781498 26215 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:25.782196 26229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.782346 26215 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:25.782452 26215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "2418f419b268400298f74e358575d87c"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "dc09da844e8bfcbaa1b64f11f62997d6"
server_key_iv: "6040ba889f567ad57bf5e4444be8740c"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.782537 26215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:25.789742 26215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:25.790056 26215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:25.790205 26215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:25.793963 26215 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34259
I20260924 17:37:25.793989 26281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34259 every 8 connection(s)
I20260924 17:37:25.794323 26215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:25.795351 26282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:25.797581 26282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c: Bootstrap starting.
I20260924 17:37:25.798151 26282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:25.798444 26282 log.cc:824] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:25.798764 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26215
I20260924 17:37:25.798907 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:25.799139 6292 external_mini_cluster.cc:1428] Setting key f623f0ae64a1d6908b9c653bdc03bdfc
I20260924 17:37:25.799296 26282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c: No bootstrap required, opened a new log
I20260924 17:37:25.801102 26282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2418f419b268400298f74e358575d87c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34259 } }
I20260924 17:37:25.801259 26282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:25.801298 26282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2418f419b268400298f74e358575d87c, State: Initialized, Role: FOLLOWER
I20260924 17:37:25.801430 26282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2418f419b268400298f74e358575d87c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34259 } }
I20260924 17:37:25.801518 26282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:25.801568 26282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:25.801615 26282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:25.802428 26282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2418f419b268400298f74e358575d87c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34259 } }
I20260924 17:37:25.802515 26282 leader_election.cc:302] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2418f419b268400298f74e358575d87c; no voters:
I20260924 17:37:25.802717 26282 leader_election.cc:288] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:25.802907 26289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:25.803002 26282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:25.803122 26289 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [term 1 LEADER]: Becoming Leader. State: Replica: 2418f419b268400298f74e358575d87c, State: Running, Role: LEADER
I20260924 17:37:25.803251 26289 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2418f419b268400298f74e358575d87c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34259 } }
I20260924 17:37:25.803702 26287 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2418f419b268400298f74e358575d87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2418f419b268400298f74e358575d87c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34259 } } }
I20260924 17:37:25.803709 26290 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2418f419b268400298f74e358575d87c. Latest consensus state: current_term: 1 leader_uuid: "2418f419b268400298f74e358575d87c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2418f419b268400298f74e358575d87c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34259 } } }
I20260924 17:37:25.803797 26287 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:25.803824 26290 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:25.804026 26297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:25.804569 26297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:25.806265 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.799689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41168 (local address 127.6.37.62:34259)
0924 17:37:25.799890 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.799897 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.799921 (+ 24us) server_negotiation.cc:407] Connection header received
0924 17:37:25.801087 (+ 1166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.801093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.801148 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.801285 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.801585 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.802629 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.803824 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.804486 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.804591 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.805564 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.805568 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.805569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:25.805766 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.805807 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:25.805823 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.805886 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.805973 (+ 87us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.806050 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260924 17:37:25.806402 26297 catalog_manager.cc:1347] Generated new cluster ID: b97eaa6fadc645a1b2fad3ac298d538c
I20260924 17:37:25.806449 26297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:25.811340 26297 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:25.811792 26297 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:25.817791 26297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c: Generated new TSK 0
I20260924 17:37:25.817974 26297 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:25.821231 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.1:0
--local_ip_for_outbound_sockets=127.6.37.1
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34259
--builtin_ntp_servers=127.6.37.20:38401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260924 17:37:25.904170 26308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:25.904448 26308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:25.904480 26308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:25.905678 26308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:25.905741 26308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:25.905786 26308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.1
I20260924 17:37:25.907184 26308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.37.1
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.1
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:25.907452 26308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:25.907752 26308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:25.912686 26314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.912707 26313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:25.912695 26316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:25.913089 26308 server_base.cc:1034] running on GCE node
I20260924 17:37:25.913300 26308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:25.913568 26308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:25.914755 26308 hybrid_clock.cc:648] HybridClock initialized: now 1790271445914740 us; error 26 us; skew 500 ppm
I20260924 17:37:25.916205 26308 webserver.cc:460] Webserver started at http://127.6.37.1:43157/ using document root <none> and password file <none>
I20260924 17:37:25.916467 26308 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:25.916522 26308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:25.916644 26308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:25.917943 26308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data/instance:
uuid: "3fead3c131d84404ab086232f29fe3a7"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "05889f1d97e083552cc34ad0905110c0"
server_key_iv: "2a86271f63ea93750f71bdf86e5bb3ba"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.918319 26308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance:
uuid: "3fead3c131d84404ab086232f29fe3a7"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "05889f1d97e083552cc34ad0905110c0"
server_key_iv: "2a86271f63ea93750f71bdf86e5bb3ba"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.919907 26308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:37:25.920750 26323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.920938 26308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:25.921046 26308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal
uuid: "3fead3c131d84404ab086232f29fe3a7"
format_stamp: "Formatted at 2026-09-24 17:37:25 on dist-test-slave-gcz9"
server_key: "05889f1d97e083552cc34ad0905110c0"
server_key_iv: "2a86271f63ea93750f71bdf86e5bb3ba"
server_key_version: "encryptionkey@0"
I20260924 17:37:25.921124 26308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:25.935384 26308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:25.935693 26308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:25.935839 26308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:25.936077 26308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:25.936405 26308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:25.936437 26308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.936460 26308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:25.936473 26308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:25.941937 26308 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.1:39557
I20260924 17:37:25.942070 26440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.1:39557 every 8 connection(s)
I20260924 17:37:25.942301 26308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/data/info.pb
I20260924 17:37:25.946450 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26308
I20260924 17:37:25.946580 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-0/wal/instance
I20260924 17:37:25.946811 6292 external_mini_cluster.cc:1428] Setting key 2fa2b537bdcaa97f06e960faba7b3aea
I20260924 17:37:25.947652 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.943058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.1:36473 (local address 127.6.37.62:34259)
0924 17:37:25.943123 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:25.943125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:25.943361 (+ 236us) server_negotiation.cc:407] Connection header received
0924 17:37:25.943846 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:25.943848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:25.943860 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:25.943912 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:25.944566 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.945062 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.945991 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.946178 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.946229 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.947347 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:25.947348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:25.947348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:25.947353 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:25.947369 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:25.947374 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:25.947462 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:25.947541 (+ 79us) server_negotiation.cc:299] Negotiation successful
0924 17:37:25.947575 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260924 17:37:25.947880 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:25.943046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34259 (local address 127.6.37.1:36473)
0924 17:37:25.943236 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:25.943270 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:25.943748 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:25.943965 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:25.943968 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:25.943977 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:25.944488 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.944493 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.945139 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.945140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.945913 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:25.945915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:25.946283 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:25.946284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:25.946454 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:25.947166 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:25.947166 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:25.947208 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:25.947244 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:25.947464 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:25.947471 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:25.947474 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:25.947546 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:37:25.947652 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":103,"threads_started":1}
I20260924 17:37:25.947916 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.2:0
--local_ip_for_outbound_sockets=127.6.37.2
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34259
--builtin_ntp_servers=127.6.37.20:38401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 17:37:25.948364 26441 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34259
I20260924 17:37:25.948472 26441 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:25.948659 26441 heartbeater.cc:511] Master 127.6.37.62:34259 requested a full tablet report, sending...
I20260924 17:37:25.949203 26246 ts_manager.cc:194] Registered new tserver with Master: 3fead3c131d84404ab086232f29fe3a7 (127.6.37.1:39557)
I20260924 17:37:25.949860 26246 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.1:36473
W20260924 17:37:26.030611 26444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:26.030861 26444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:26.030923 26444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:26.032094 26444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:26.032160 26444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:26.032203 26444 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.2
I20260924 17:37:26.033803 26444 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.37.2
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.2
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:26.034062 26444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:26.034327 26444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:26.039320 26452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:26.039335 26449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:26.039431 26450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:26.039613 26444 server_base.cc:1034] running on GCE node
I20260924 17:37:26.039872 26444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:26.040129 26444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:26.041325 26444 hybrid_clock.cc:648] HybridClock initialized: now 1790271446041304 us; error 47 us; skew 500 ppm
I20260924 17:37:26.042600 26444 webserver.cc:460] Webserver started at http://127.6.37.2:34391/ using document root <none> and password file <none>
I20260924 17:37:26.042901 26444 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:26.042968 26444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:26.043066 26444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:26.044087 26444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data/instance:
uuid: "d47e4eb25bff45f6adf316cb22e1b942"
format_stamp: "Formatted at 2026-09-24 17:37:26 on dist-test-slave-gcz9"
server_key: "f2113178b305a59bd974c2266c9bd84e"
server_key_iv: "64a67e6d966d08397af9dc4588032e1d"
server_key_version: "encryptionkey@0"
I20260924 17:37:26.044404 26444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance:
uuid: "d47e4eb25bff45f6adf316cb22e1b942"
format_stamp: "Formatted at 2026-09-24 17:37:26 on dist-test-slave-gcz9"
server_key: "f2113178b305a59bd974c2266c9bd84e"
server_key_iv: "64a67e6d966d08397af9dc4588032e1d"
server_key_version: "encryptionkey@0"
I20260924 17:37:26.045655 26444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:26.046407 26458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:26.046603 26444 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:26.046681 26444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal
uuid: "d47e4eb25bff45f6adf316cb22e1b942"
format_stamp: "Formatted at 2026-09-24 17:37:26 on dist-test-slave-gcz9"
server_key: "f2113178b305a59bd974c2266c9bd84e"
server_key_iv: "64a67e6d966d08397af9dc4588032e1d"
server_key_version: "encryptionkey@0"
I20260924 17:37:26.046741 26444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:26.060827 26444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:26.061113 26444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:26.061224 26444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:26.061440 26444 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:26.061734 26444 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:26.061767 26444 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:26.061797 26444 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:26.061820 26444 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:26.068269 26444 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.2:42865
I20260924 17:37:26.068389 26573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.2:42865 every 8 connection(s)
I20260924 17:37:26.068787 26444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/data/info.pb
I20260924 17:37:26.073235 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26444
I20260924 17:37:26.073338 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal/instance
I20260924 17:37:26.073531 6292 external_mini_cluster.cc:1428] Setting key d83b1b52992f8fb1f35ee80c46b1f264
I20260924 17:37:26.074424 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.37.3:0
--local_ip_for_outbound_sockets=127.6.37.3
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34259
--builtin_ntp_servers=127.6.37.20:38401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260924 17:37:26.074858 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.069611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:60621 (local address 127.6.37.62:34259)
0924 17:37:26.069695 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.069697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.070438 (+ 741us) server_negotiation.cc:407] Connection header received
0924 17:37:26.070988 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.070989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.071002 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.071068 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:26.071720 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.072213 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.073216 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.073550 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.073629 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.074504 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:26.074505 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:26.074506 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:26.074512 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:26.074528 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:26.074534 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:26.074591 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.074708 (+ 117us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.074737 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:37:26.075368 26576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.070092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34259 (local address 127.6.37.2:60621)
0924 17:37:26.070309 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.070343 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.070825 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.071133 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.071136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.071144 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:26.071647 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.071651 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.072293 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.072294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.073129 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.073131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.073655 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.073657 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.073777 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.074358 (+ 581us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:26.074359 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:26.074388 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:26.074410 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:26.074620 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:26.074627 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:26.074630 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.074974 (+ 344us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.075111 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
I20260924 17:37:26.075917 26574 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34259
I20260924 17:37:26.076030 26574 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:26.076236 26574 heartbeater.cc:511] Master 127.6.37.62:34259 requested a full tablet report, sending...
I20260924 17:37:26.076653 26246 ts_manager.cc:194] Registered new tserver with Master: d47e4eb25bff45f6adf316cb22e1b942 (127.6.37.2:42865)
I20260924 17:37:26.077157 26246 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.2:60621
W20260924 17:37:26.156507 26577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:26.156694 26577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:26.156714 26577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:26.157866 26577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:26.157905 26577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:26.157929 26577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.37.3
I20260924 17:37:26.159276 26577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:38401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.37.3
--webserver_port=0
--tserver_master_addrs=127.6.37.62:34259
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.37.3
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:26.159518 26577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:26.159767 26577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:26.164772 26582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:26.164774 26583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:26.164762 26585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:26.164985 26577 server_base.cc:1034] running on GCE node
I20260924 17:37:26.165203 26577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:26.165449 26577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:26.166610 26577 hybrid_clock.cc:648] HybridClock initialized: now 1790271446166592 us; error 27 us; skew 500 ppm
I20260924 17:37:26.168026 26577 webserver.cc:460] Webserver started at http://127.6.37.3:43841/ using document root <none> and password file <none>
I20260924 17:37:26.168319 26577 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:26.168371 26577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:26.168565 26577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:26.169759 26577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data/instance:
uuid: "6ea324c6ceaa494cbabc91308a21916c"
format_stamp: "Formatted at 2026-09-24 17:37:26 on dist-test-slave-gcz9"
server_key: "5e1642f840fffdbfa17273f1b8bf82c9"
server_key_iv: "4d65dd307eb4ff5d8915a6ad07153ea5"
server_key_version: "encryptionkey@0"
I20260924 17:37:26.170183 26577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance:
uuid: "6ea324c6ceaa494cbabc91308a21916c"
format_stamp: "Formatted at 2026-09-24 17:37:26 on dist-test-slave-gcz9"
server_key: "5e1642f840fffdbfa17273f1b8bf82c9"
server_key_iv: "4d65dd307eb4ff5d8915a6ad07153ea5"
server_key_version: "encryptionkey@0"
I20260924 17:37:26.171651 26577 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:26.172435 26591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:26.172632 26577 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:26.172710 26577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal
uuid: "6ea324c6ceaa494cbabc91308a21916c"
format_stamp: "Formatted at 2026-09-24 17:37:26 on dist-test-slave-gcz9"
server_key: "5e1642f840fffdbfa17273f1b8bf82c9"
server_key_iv: "4d65dd307eb4ff5d8915a6ad07153ea5"
server_key_version: "encryptionkey@0"
I20260924 17:37:26.172811 26577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:26.189951 26577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:26.190271 26577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:26.190442 26577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:26.190680 26577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260924 17:37:26.191128 26577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260924 17:37:26.191166 26577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:26.191212 26577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260924 17:37:26.191243 26577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:26.197849 26577 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.3:35021
I20260924 17:37:26.197921 26706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.3:35021 every 8 connection(s)
I20260924 17:37:26.198263 26577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/data/info.pb
I20260924 17:37:26.200649 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26577
I20260924 17:37:26.200769 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal/instance
I20260924 17:37:26.200973 6292 external_mini_cluster.cc:1428] Setting key 743c68d26ad5d7958b5859db9295a8e3
I20260924 17:37:26.204473 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.199152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.3:59207 (local address 127.6.37.62:34259)
0924 17:37:26.199203 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.199205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.199473 (+ 268us) server_negotiation.cc:407] Connection header received
0924 17:37:26.199991 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.199992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.200004 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.200073 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:26.200935 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.201542 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.202797 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.203070 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.203166 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.204137 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:26.204139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:26.204139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:26.204144 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:26.204159 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:26.204164 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:26.204217 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.204319 (+ 102us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.204382 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:37:26.204668 26709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.199156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:34259 (local address 127.6.37.3:59207)
0924 17:37:26.199346 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.199380 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.199895 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.200133 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.200137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.200145 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:26.200809 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.200817 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.201761 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.201762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.202694 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.202697 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.203184 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.203186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.203315 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.203983 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0924 17:37:26.203983 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:26.204012 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0924 17:37:26.204034 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:26.204223 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:26.204228 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:26.204231 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.204321 (+ 90us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.204427 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260924 17:37:26.205157 26707 heartbeater.cc:347] Connected to a master server at 127.6.37.62:34259
I20260924 17:37:26.205263 26707 heartbeater.cc:464] Registering TS with master...
I20260924 17:37:26.205444 26707 heartbeater.cc:511] Master 127.6.37.62:34259 requested a full tablet report, sending...
I20260924 17:37:26.205816 26246 ts_manager.cc:194] Registered new tserver with Master: 6ea324c6ceaa494cbabc91308a21916c (127.6.37.3:35021)
I20260924 17:37:26.206168 26246 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.37.3:59207
I20260924 17:37:26.212738 6292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260924 17:37:26.217509 26286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.214109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41172 (local address 127.6.37.62:34259)
0924 17:37:26.214194 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.214197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.214271 (+ 74us) server_negotiation.cc:407] Connection header received
0924 17:37:26.214354 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.214355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.214369 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.214439 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:26.214637 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.215223 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.216239 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.216454 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.216543 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.217199 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:26.217200 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:26.217201 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:26.217206 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:26.217222 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:26.217227 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:26.217317 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.217387 (+ 70us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.217415 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260924 17:37:26.219173 26246 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41172:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260924 17:37:26.220772 26246 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260924 17:37:26.227210 26719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.223234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:39557 (local address 127.0.0.1:53398)
0924 17:37:26.223619 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.223629 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.223677 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.223934 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.223935 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.223937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:26.223982 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.223984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.225255 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.225256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.226196 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.226200 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.226908 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.226909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.226985 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.227008 (+ 23us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.227085 (+ 77us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.227138 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":70,"threads_started":1}
I20260924 17:37:26.227227 26720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.223362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53398 (local address 127.6.37.1:39557)
0924 17:37:26.223566 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.223570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.223730 (+ 160us) server_negotiation.cc:407] Connection header received
0924 17:37:26.223775 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.223777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.223792 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.223862 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:26.224061 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.225174 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.226277 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.226802 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.226914 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.227015 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.227099 (+ 84us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.227138 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":85,"threads_started":1}
I20260924 17:37:26.227451 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.223015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.2:42865 (local address 127.0.0.1:56270)
0924 17:37:26.223363 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.223402 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.223465 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.223771 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.223775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.223777 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:26.223842 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.223843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.224834 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.224835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.226116 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.226119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.227197 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.227199 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.227263 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.227267 (+ 4us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.227321 (+ 54us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.227378 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260924 17:37:26.227501 26718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.223140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49602 (local address 127.6.37.3:35021)
0924 17:37:26.223386 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.223392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.223583 (+ 191us) server_negotiation.cc:407] Connection header received
0924 17:37:26.223629 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.223631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.223645 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.223703 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:26.223909 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.225110 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.226339 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.227066 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.227123 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.227197 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.227378 (+ 181us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.227415 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":106,"threads_started":1}
I20260924 17:37:26.227690 26717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.223121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56270 (local address 127.6.37.2:42865)
0924 17:37:26.223475 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.223479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.223490 (+ 11us) server_negotiation.cc:407] Connection header received
0924 17:37:26.223549 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.223552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.223569 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.223647 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:26.223985 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.224753 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.226207 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.226994 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.227066 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.227159 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.227569 (+ 410us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.227616 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":97,"threads_started":1}
I20260924 17:37:26.227706 26715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.223011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35021 (local address 127.0.0.1:49602)
0924 17:37:26.223352 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.223398 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.223467 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.223810 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.223811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.223812 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:26.223842 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.223843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.225200 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.225201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.226276 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.226278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.227225 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.227226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.227275 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.227278 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.227322 (+ 44us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.227642 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"mutex_wait_us":296,"thread_start_us":69,"threads_started":1}
I20260924 17:37:26.228359 26372 tablet_service.cc:1467] Processing CreateTablet for tablet 418e121a719b4065b99814bf8282fc5d (DEFAULT_TABLE table=test-table [id=424d79d86334476fbe885ed510e07415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:26.228444 26507 tablet_service.cc:1467] Processing CreateTablet for tablet 418e121a719b4065b99814bf8282fc5d (DEFAULT_TABLE table=test-table [id=424d79d86334476fbe885ed510e07415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:26.228650 26372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418e121a719b4065b99814bf8282fc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:26.228693 26507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418e121a719b4065b99814bf8282fc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:26.231259 26721 tablet_bootstrap.cc:492] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Bootstrap starting.
I20260924 17:37:26.231293 26641 tablet_service.cc:1467] Processing CreateTablet for tablet 418e121a719b4065b99814bf8282fc5d (DEFAULT_TABLE table=test-table [id=424d79d86334476fbe885ed510e07415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260924 17:37:26.231428 26722 tablet_bootstrap.cc:492] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Bootstrap starting.
I20260924 17:37:26.231554 26641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 418e121a719b4065b99814bf8282fc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:26.231971 26721 tablet_bootstrap.cc:654] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:26.231977 26722 tablet_bootstrap.cc:654] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:26.232297 26721 log.cc:824] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:26.232297 26722 log.cc:824] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:26.233057 26721 tablet_bootstrap.cc:492] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: No bootstrap required, opened a new log
I20260924 17:37:26.233114 26721 ts_tablet_manager.cc:1397] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:26.233389 26722 tablet_bootstrap.cc:492] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: No bootstrap required, opened a new log
I20260924 17:37:26.233443 26722 ts_tablet_manager.cc:1397] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:26.234503 26725 tablet_bootstrap.cc:492] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Bootstrap starting.
I20260924 17:37:26.235195 26725 tablet_bootstrap.cc:654] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:26.235518 26725 log.cc:824] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:26.236205 26725 tablet_bootstrap.cc:492] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: No bootstrap required, opened a new log
I20260924 17:37:26.236301 26725 ts_tablet_manager.cc:1397] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:26.236279 26721 raft_consensus.cc:348] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.236466 26721 raft_consensus.cc:374] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:26.236511 26721 raft_consensus.cc:729] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fead3c131d84404ab086232f29fe3a7, State: Initialized, Role: FOLLOWER
I20260924 17:37:26.236450 26722 raft_consensus.cc:348] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.236580 26722 raft_consensus.cc:374] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:26.236619 26722 raft_consensus.cc:729] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d47e4eb25bff45f6adf316cb22e1b942, State: Initialized, Role: FOLLOWER
I20260924 17:37:26.236647 26721 consensus_queue.cc:260] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.236745 26722 consensus_queue.cc:260] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.236933 26721 ts_tablet_manager.cc:1428] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260924 17:37:26.237020 26722 ts_tablet_manager.cc:1428] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260924 17:37:26.237162 26574 heartbeater.cc:503] Master 127.6.37.62:34259 was elected leader, sending a full tablet report...
I20260924 17:37:26.237186 26441 heartbeater.cc:503] Master 127.6.37.62:34259 was elected leader, sending a full tablet report...
I20260924 17:37:26.238941 26725 raft_consensus.cc:348] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.239127 26725 raft_consensus.cc:374] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:26.239178 26725 raft_consensus.cc:729] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea324c6ceaa494cbabc91308a21916c, State: Initialized, Role: FOLLOWER
I20260924 17:37:26.239310 26725 consensus_queue.cc:260] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.239568 26725 ts_tablet_manager.cc:1428] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260924 17:37:26.239635 26707 heartbeater.cc:503] Master 127.6.37.62:34259 was elected leader, sending a full tablet report...
W20260924 17:37:26.319363 26575 tablet.cc:2369] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:26.404561 26728 raft_consensus.cc:482] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260924 17:37:26.404696 26728 raft_consensus.cc:504] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.405124 26728 leader_election.cc:288] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ea324c6ceaa494cbabc91308a21916c (127.6.37.3:35021), 3fead3c131d84404ab086232f29fe3a7 (127.6.37.1:39557)
I20260924 17:37:26.407975 26720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.405411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:37055 (local address 127.6.37.1:39557)
0924 17:37:26.405467 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.405470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.405503 (+ 33us) server_negotiation.cc:407] Connection header received
0924 17:37:26.405537 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.405538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.405550 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.405627 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:26.405788 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.406268 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.407246 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.407632 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.407712 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.407722 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.407865 (+ 143us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.407902 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:37:26.408012 26576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.405302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:39557 (local address 127.6.37.2:37055)
0924 17:37:26.405380 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.405395 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.405462 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.405634 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.405636 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.405637 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:26.405713 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.405715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.406359 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.406360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.407159 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.407161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.407723 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.407724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.407793 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.407796 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.407859 (+ 63us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.407902 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260924 17:37:26.408035 26718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.405490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.6.37.2:36773 (local address 127.6.37.3:35021)
0924 17:37:26.405548 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.405550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.405579 (+ 29us) server_negotiation.cc:407] Connection header received
0924 17:37:26.405649 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.405650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.405658 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.405724 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0924 17:37:26.405906 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.406354 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.407282 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.407672 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.407753 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.407764 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.407918 (+ 154us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.407954 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:26.408272 26730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.405309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.3:35021 (local address 127.6.37.2:36773)
0924 17:37:26.405518 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.405529 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:26.405584 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:26.405743 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:26.405744 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:26.405745 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0924 17:37:26.405822 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.405823 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.406438 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.406439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.407188 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:26.407190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.407766 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.407767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:26.407843 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.407846 (+ 3us) client_negotiation.cc:769] Sending connection context
0924 17:37:26.407912 (+ 66us) client_negotiation.cc:240] Negotiation successful
0924 17:37:26.407949 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":22,"thread_start_us":96,"threads_started":1}
I20260924 17:37:26.408383 26393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418e121a719b4065b99814bf8282fc5d" candidate_uuid: "d47e4eb25bff45f6adf316cb22e1b942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead3c131d84404ab086232f29fe3a7" is_pre_election: true
I20260924 17:37:26.408579 26393 raft_consensus.cc:2454] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d47e4eb25bff45f6adf316cb22e1b942 in term 0.
I20260924 17:37:26.408859 26462 leader_election.cc:302] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fead3c131d84404ab086232f29fe3a7, d47e4eb25bff45f6adf316cb22e1b942; no voters:
I20260924 17:37:26.408998 26728 raft_consensus.cc:2781] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260924 17:37:26.409057 26728 raft_consensus.cc:482] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260924 17:37:26.409003 26661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418e121a719b4065b99814bf8282fc5d" candidate_uuid: "d47e4eb25bff45f6adf316cb22e1b942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea324c6ceaa494cbabc91308a21916c" is_pre_election: true
I20260924 17:37:26.409081 26728 raft_consensus.cc:3037] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:26.409150 26661 raft_consensus.cc:2454] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d47e4eb25bff45f6adf316cb22e1b942 in term 0.
I20260924 17:37:26.409855 26728 raft_consensus.cc:504] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.410007 26728 leader_election.cc:288] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [CANDIDATE]: Term 1 election: Requested vote from peers 6ea324c6ceaa494cbabc91308a21916c (127.6.37.3:35021), 3fead3c131d84404ab086232f29fe3a7 (127.6.37.1:39557)
I20260924 17:37:26.410132 26393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418e121a719b4065b99814bf8282fc5d" candidate_uuid: "d47e4eb25bff45f6adf316cb22e1b942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fead3c131d84404ab086232f29fe3a7"
I20260924 17:37:26.410154 26661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "418e121a719b4065b99814bf8282fc5d" candidate_uuid: "d47e4eb25bff45f6adf316cb22e1b942" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea324c6ceaa494cbabc91308a21916c"
I20260924 17:37:26.410213 26393 raft_consensus.cc:3037] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:26.410238 26661 raft_consensus.cc:3037] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:26.411032 26393 raft_consensus.cc:2454] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d47e4eb25bff45f6adf316cb22e1b942 in term 1.
I20260924 17:37:26.411036 26661 raft_consensus.cc:2454] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d47e4eb25bff45f6adf316cb22e1b942 in term 1.
I20260924 17:37:26.411216 26461 leader_election.cc:302] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea324c6ceaa494cbabc91308a21916c, d47e4eb25bff45f6adf316cb22e1b942; no voters:
I20260924 17:37:26.411338 26728 raft_consensus.cc:2781] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:26.411518 26728 raft_consensus.cc:686] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 1 LEADER]: Becoming Leader. State: Replica: d47e4eb25bff45f6adf316cb22e1b942, State: Running, Role: LEADER
I20260924 17:37:26.411623 26728 consensus_queue.cc:237] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } }
I20260924 17:37:26.412460 26245 catalog_manager.cc:5495] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 reported cstate change: term changed from 0 to 1, leader changed from <none> to d47e4eb25bff45f6adf316cb22e1b942 (127.6.37.2). New cstate: current_term: 1 leader_uuid: "d47e4eb25bff45f6adf316cb22e1b942" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d47e4eb25bff45f6adf316cb22e1b942" member_type: VOTER last_known_addr { host: "127.6.37.2" port: 42865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 } health_report { overall_health: UNKNOWN } } }
W20260924 17:37:26.443060 26442 tablet.cc:2369] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260924 17:37:26.448864 26708 tablet.cc:2369] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260924 17:37:26.453189 26717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.450969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56280 (local address 127.6.37.2:42865)
0924 17:37:26.451032 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:26.451035 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:26.451053 (+ 18us) server_negotiation.cc:407] Connection header received
0924 17:37:26.451131 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:26.451131 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:26.451153 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:26.451229 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:26.451346 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.451815 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.452526 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:26.452707 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:26.452756 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:26.452885 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:26.452996 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:26.453057 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:26.453093 (+ 36us) server_negotiation.cc:299] Negotiation successful
0924 17:37:26.453110 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:37:26.455144 26661 raft_consensus.cc:1261] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 1 FOLLOWER]: Refusing update from remote peer d47e4eb25bff45f6adf316cb22e1b942: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:26.455144 26393 raft_consensus.cc:1261] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 1 FOLLOWER]: Refusing update from remote peer d47e4eb25bff45f6adf316cb22e1b942: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:26.455590 26731 consensus_queue.cc:1035] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fead3c131d84404ab086232f29fe3a7" member_type: VOTER last_known_addr { host: "127.6.37.1" port: 39557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:26.455741 26728 consensus_queue.cc:1035] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea324c6ceaa494cbabc91308a21916c" member_type: VOTER last_known_addr { host: "127.6.37.3" port: 35021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:26.460431 26244 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:26.460536 26244 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41172:
table { table_name: "test-table" } modify_external_catalogs: true
I20260924 17:37:26.461320 26244 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2418f419b268400298f74e358575d87c: Sending DeleteTablet for 3 replicas of tablet 418e121a719b4065b99814bf8282fc5d
I20260924 17:37:26.461673 26372 tablet_service.cc:1514] Processing DeleteTablet for tablet 418e121a719b4065b99814bf8282fc5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:26 UTC) from {username='slave'} at 127.0.0.1:53398
I20260924 17:37:26.461810 26641 tablet_service.cc:1514] Processing DeleteTablet for tablet 418e121a719b4065b99814bf8282fc5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:26 UTC) from {username='slave'} at 127.0.0.1:49602
I20260924 17:37:26.461895 26745 tablet_replica.cc:330] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: stopping tablet replica
I20260924 17:37:26.462001 26745 raft_consensus.cc:2229] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:26.462113 26745 raft_consensus.cc:2258] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:26.462148 26507 tablet_service.cc:1514] Processing DeleteTablet for tablet 418e121a719b4065b99814bf8282fc5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-24 17:37:26 UTC) from {username='slave'} at 127.0.0.1:56270
I20260924 17:37:26.462389 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26308
I20260924 17:37:26.462445 26746 tablet_replica.cc:330] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: stopping tablet replica
I20260924 17:37:26.462541 26746 raft_consensus.cc:2229] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260924 17:37:26.462635 26746 raft_consensus.cc:2258] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:26.462690 26745 ts_tablet_manager.cc:1905] T 418e121a719b4065b99814bf8282fc5d P 3fead3c131d84404ab086232f29fe3a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:26.463024 26747 tablet_replica.cc:330] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: stopping tablet replica
I20260924 17:37:26.463107 26747 raft_consensus.cc:2229] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 1 LEADER]: Raft consensus shutting down.
I20260924 17:37:26.463212 26747 raft_consensus.cc:2258] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260924 17:37:26.463599 26747 ts_tablet_manager.cc:1905] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:26.463933 26746 ts_tablet_manager.cc:1905] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260924 17:37:26.465517 26747 ts_tablet_manager.cc:1918] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:26.465590 26747 log.cc:1196] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-1/wal/wals/418e121a719b4065b99814bf8282fc5d
I20260924 17:37:26.465588 26746 ts_tablet_manager.cc:1918] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260924 17:37:26.465643 26746 log.cc:1196] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Deleting WAL directory at /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790271173812085-6292-0/minicluster-data/ts-2/wal/wals/418e121a719b4065b99814bf8282fc5d
I20260924 17:37:26.465874 26746 ts_tablet_manager.cc:1939] T 418e121a719b4065b99814bf8282fc5d P 6ea324c6ceaa494cbabc91308a21916c: Deleting consensus metadata
I20260924 17:37:26.465873 26747 ts_tablet_manager.cc:1939] T 418e121a719b4065b99814bf8282fc5d P d47e4eb25bff45f6adf316cb22e1b942: Deleting consensus metadata
I20260924 17:37:26.466251 26233 catalog_manager.cc:4841] TS d47e4eb25bff45f6adf316cb22e1b942 (127.6.37.2:42865): tablet 418e121a719b4065b99814bf8282fc5d (table test-table [id=424d79d86334476fbe885ed510e07415]) successfully deleted
I20260924 17:37:26.466251 26232 catalog_manager.cc:4841] TS 6ea324c6ceaa494cbabc91308a21916c (127.6.37.3:35021): tablet 418e121a719b4065b99814bf8282fc5d (table test-table [id=424d79d86334476fbe885ed510e07415]) successfully deleted
W20260924 17:37:26.471097 26233 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.6.37.1:39557 (error 108)
I20260924 17:37:26.471302 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26444
I20260924 17:37:26.471987 26715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:26.471431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.1:39557 (local address 127.0.0.1:53400)
0924 17:37:26.471908 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:26.471949 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.1:39557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454}
W20260924 17:37:26.472757 26233 catalog_manager.cc:4584] TS 3fead3c131d84404ab086232f29fe3a7 (127.6.37.1:39557): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 418e121a719b4065b99814bf8282fc5d: Network error: Client connection negotiation failed: client connection to 127.6.37.1:39557: connect: Connection refused (error 111)
I20260924 17:37:26.476004 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26577
I20260924 17:37:26.483404 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26215
2026-09-24T17:37:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (825 ms)
[----------] 6 tests from EncryptionPolicyTest (8196 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:26 dist-test-slave-gcz9 krb5kdc[26751](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:26 dist-test-slave-gcz9 krb5kdc[26751](info): set up 2 sockets
Sep 24 17:37:26 dist-test-slave-gcz9 krb5kdc[26751](info): commencing operation
krb5kdc: starting...
W20260924 17:37:27.524744 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:27 dist-test-slave-gcz9 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:27.639432 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45801
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45801
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:27.722114 26764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:27.722343 26764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:27.722381 26764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:27.723589 26764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:27.723658 26764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:27.723683 26764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:27.723704 26764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:27.723734 26764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:27.725246 26764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45801
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45801
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:27.725533 26764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:27.725760 26764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:27.730504 26770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:27.730515 26771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:27.730593 26764 server_base.cc:1034] running on GCE node
W20260924 17:37:27.730518 26773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:27.731063 26764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:27.731362 26764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:27.732582 26764 hybrid_clock.cc:648] HybridClock initialized: now 1790271447732570 us; error 47 us; skew 500 ppm
Sep 24 17:37:27 dist-test-slave-gcz9 krb5kdc[26751](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271447, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:27.735064 26764 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:27.735541 26764 webserver.cc:460] Webserver started at http://127.0.0.1:40401/ using document root <none> and password file <none>
I20260924 17:37:27.735786 26764 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:27.735857 26764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:27.736006 26764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:27.737056 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "25e9d83105584b46836ecbd7aeee7bcd"
format_stamp: "Formatted at 2026-09-24 17:37:27 on dist-test-slave-gcz9"
server_key: "66abb354dab586c49bf3485b40c05da0"
server_key_iv: "f9fa7ae6dce3bb23df9c061a85984820"
server_key_version: "encryptionkey@0"
I20260924 17:37:27.737413 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "25e9d83105584b46836ecbd7aeee7bcd"
format_stamp: "Formatted at 2026-09-24 17:37:27 on dist-test-slave-gcz9"
server_key: "66abb354dab586c49bf3485b40c05da0"
server_key_iv: "f9fa7ae6dce3bb23df9c061a85984820"
server_key_version: "encryptionkey@0"
I20260924 17:37:27.738718 26764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:27.739488 26780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:27.739667 26764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:27.739773 26764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "25e9d83105584b46836ecbd7aeee7bcd"
format_stamp: "Formatted at 2026-09-24 17:37:27 on dist-test-slave-gcz9"
server_key: "66abb354dab586c49bf3485b40c05da0"
server_key_iv: "f9fa7ae6dce3bb23df9c061a85984820"
server_key_version: "encryptionkey@0"
I20260924 17:37:27.739857 26764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:27.768203 26764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:27.770102 26764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:27.770275 26764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:27.774537 26764 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45801
I20260924 17:37:27.774571 26833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45801 every 8 connection(s)
I20260924 17:37:27.774951 26764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:27.775981 26834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:27.778337 26834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd: Bootstrap starting.
I20260924 17:37:27.779013 26834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:27.779310 26834 log.cc:824] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:27.780033 26834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd: No bootstrap required, opened a new log
I20260924 17:37:27.781622 26834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e9d83105584b46836ecbd7aeee7bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45801 } }
I20260924 17:37:27.781759 26834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:27.781807 26834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e9d83105584b46836ecbd7aeee7bcd, State: Initialized, Role: FOLLOWER
I20260924 17:37:27.781987 26834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e9d83105584b46836ecbd7aeee7bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45801 } }
I20260924 17:37:27.782069 26834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:27.782114 26834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:27.782160 26834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:27.782681 26834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e9d83105584b46836ecbd7aeee7bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45801 } }
I20260924 17:37:27.782795 26834 leader_election.cc:302] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25e9d83105584b46836ecbd7aeee7bcd; no voters:
I20260924 17:37:27.783005 26834 leader_election.cc:288] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:27.783077 26837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:27.783262 26837 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [term 1 LEADER]: Becoming Leader. State: Replica: 25e9d83105584b46836ecbd7aeee7bcd, State: Running, Role: LEADER
I20260924 17:37:27.783267 26834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:27.783366 26837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e9d83105584b46836ecbd7aeee7bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45801 } }
I20260924 17:37:27.783728 26839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e9d83105584b46836ecbd7aeee7bcd. Latest consensus state: current_term: 1 leader_uuid: "25e9d83105584b46836ecbd7aeee7bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e9d83105584b46836ecbd7aeee7bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45801 } } }
I20260924 17:37:27.783818 26839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:27.783855 26838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25e9d83105584b46836ecbd7aeee7bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e9d83105584b46836ecbd7aeee7bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45801 } } }
I20260924 17:37:27.783924 26838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:27.783977 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26764
I20260924 17:37:27.784037 26843 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:27.784092 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:27.784296 6292 external_mini_cluster.cc:1428] Setting key 4c81997ef09faceeb1d962716aea778a
I20260924 17:37:27.784566 26843 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:27.786369 26843 catalog_manager.cc:1347] Generated new cluster ID: a26534ab8b6e488ab9545f95994bbe53
I20260924 17:37:27.786423 26843 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:37:27 dist-test-slave-gcz9 krb5kdc[26751](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 17:37:27.796365 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:27.784985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57437 (local address 127.0.0.1:45801)
0924 17:37:27.785146 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:27.785155 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:27.785188 (+ 33us) server_negotiation.cc:407] Connection header received
0924 17:37:27.785311 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:27.785320 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:27.785378 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:27.786435 (+ 1057us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:27.786533 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:27.787914 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:27.789043 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:27.789674 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:27.789775 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:27.792590 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:27.792595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:27.792595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:27.792608 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:27.794621 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:27.795082 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:27.795086 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:27.795086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:27.795210 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:27.795448 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:27.795449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:27.795449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:27.795757 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:27.795934 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:27.796025 (+ 91us) server_negotiation.cc:299] Negotiation successful
0924 17:37:27.796128 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260924 17:37:27.797603 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:27.798858 26843 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:27.799572 26843 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:27.803526 26843 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25e9d83105584b46836ecbd7aeee7bcd: Generated new TSK 0
I20260924 17:37:27.803707 26843 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:27.806452 26847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:27.799207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40531 (local address 127.0.0.1:45801)
0924 17:37:27.799240 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:27.799242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:27.799287 (+ 45us) server_negotiation.cc:407] Connection header received
0924 17:37:27.799360 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:27.799360 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:27.799571 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:27.799638 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:27.800318 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:27.801071 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:27.802109 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:27.802423 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:27.802482 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:27.803891 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:27.803892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:27.803892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:27.803899 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:27.805338 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:27.805744 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:27.805745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:27.805745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:27.805793 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:27.806030 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:27.806031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:27.806031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:27.806122 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:27.806195 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:27.806351 (+ 156us) server_negotiation.cc:299] Negotiation successful
0924 17:37:27.806396 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:27.808955 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26764
W20260924 17:37:27.814116 26749 connection.cc:535] client connection to 127.0.0.1:45801 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45801): Connection reset by peer (error 104)
2026-09-24T17:37:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1325 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:27 dist-test-slave-gcz9 krb5kdc[26866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:27 dist-test-slave-gcz9 krb5kdc[26866](info): set up 2 sockets
Sep 24 17:37:27 dist-test-slave-gcz9 krb5kdc[26866](info): commencing operation
krb5kdc: starting...
W20260924 17:37:28.844842 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:28 dist-test-slave-gcz9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271448, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:28.961635 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35459
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35011
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:29.041677 26879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:29.041921 26879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:29.041960 26879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:29.043139 26879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:29.043212 26879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:29.043236 26879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:29.043265 26879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:29.043296 26879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:29.044761 26879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35011
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35459
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:29.045044 26879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:29.045275 26879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:29.050092 26885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:29.050104 26887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:29.050082 26884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:29.050388 26879 server_base.cc:1034] running on GCE node
I20260924 17:37:29.050642 26879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:29.051011 26879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:29.052182 26879 hybrid_clock.cc:648] HybridClock initialized: now 1790271449052169 us; error 25 us; skew 500 ppm
Sep 24 17:37:29 dist-test-slave-gcz9 krb5kdc[26866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271449, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:29.060767 26879 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:29.061280 26879 webserver.cc:460] Webserver started at http://127.0.0.1:44759/ using document root <none> and password file <none>
I20260924 17:37:29.061519 26879 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:29.061587 26879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:29.061723 26879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:29.062799 26879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "58a189bb169c47e296d78defdbfa3b15"
format_stamp: "Formatted at 2026-09-24 17:37:29 on dist-test-slave-gcz9"
server_key: "73371551a8fa199bfc7eece1f2845183"
server_key_iv: "247bca9c928cf04bafebe522a609b40c"
server_key_version: "encryptionkey@0"
I20260924 17:37:29.063244 26879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "58a189bb169c47e296d78defdbfa3b15"
format_stamp: "Formatted at 2026-09-24 17:37:29 on dist-test-slave-gcz9"
server_key: "73371551a8fa199bfc7eece1f2845183"
server_key_iv: "247bca9c928cf04bafebe522a609b40c"
server_key_version: "encryptionkey@0"
I20260924 17:37:29.064556 26879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:29.065304 26894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:29.065471 26879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:29.065573 26879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "58a189bb169c47e296d78defdbfa3b15"
format_stamp: "Formatted at 2026-09-24 17:37:29 on dist-test-slave-gcz9"
server_key: "73371551a8fa199bfc7eece1f2845183"
server_key_iv: "247bca9c928cf04bafebe522a609b40c"
server_key_version: "encryptionkey@0"
I20260924 17:37:29.065654 26879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:29.072530 26879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:29.074178 26879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:29.074339 26879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:29.078274 26879 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35459
I20260924 17:37:29.078310 26946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35459 every 8 connection(s)
I20260924 17:37:29.078632 26879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:29.079607 26947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:29.081847 26947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15: Bootstrap starting.
I20260924 17:37:29.082386 26947 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:29.082639 26947 log.cc:824] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:29.083277 26947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15: No bootstrap required, opened a new log
I20260924 17:37:29.084779 26947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58a189bb169c47e296d78defdbfa3b15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260924 17:37:29.084908 26947 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:29.084929 26947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a189bb169c47e296d78defdbfa3b15, State: Initialized, Role: FOLLOWER
I20260924 17:37:29.085060 26947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58a189bb169c47e296d78defdbfa3b15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260924 17:37:29.085141 26947 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:29.085165 26947 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:29.085192 26947 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:29.085660 26947 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58a189bb169c47e296d78defdbfa3b15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260924 17:37:29.085739 26947 leader_election.cc:302] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58a189bb169c47e296d78defdbfa3b15; no voters:
I20260924 17:37:29.085855 26947 leader_election.cc:288] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:29.085919 26950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:29.086086 26950 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [term 1 LEADER]: Becoming Leader. State: Replica: 58a189bb169c47e296d78defdbfa3b15, State: Running, Role: LEADER
I20260924 17:37:29.086103 26947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:29.086174 26950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58a189bb169c47e296d78defdbfa3b15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } }
I20260924 17:37:29.086678 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26879
I20260924 17:37:29.086800 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:29.087051 6292 external_mini_cluster.cc:1428] Setting key 591d3f7b82d033b1d654c6cbd8ae7ba9
I20260924 17:37:29.087781 26951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58a189bb169c47e296d78defdbfa3b15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58a189bb169c47e296d78defdbfa3b15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } } }
I20260924 17:37:29.087880 26951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:29.087981 26952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58a189bb169c47e296d78defdbfa3b15. Latest consensus state: current_term: 1 leader_uuid: "58a189bb169c47e296d78defdbfa3b15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58a189bb169c47e296d78defdbfa3b15" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35459 } } }
I20260924 17:37:29.088294 26952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15 [sys.catalog]: This master's current role is: LEADER
W20260924 17:37:29.088335 26967 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:29.088394 26967 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:29.088480 26970 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:29.088677 26970 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:29.090071 26970 catalog_manager.cc:1347] Generated new cluster ID: 317a92a85acc48cca18fb6988e0a382e
I20260924 17:37:29.090121 26970 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:29.093480 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:29.087920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44241 (local address 127.0.0.1:35459)
0924 17:37:29.088205 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:29.088215 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:29.088251 (+ 36us) server_negotiation.cc:407] Connection header received
0924 17:37:29.088374 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:29.088382 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:29.088458 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:29.088644 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:29.088929 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:29.090268 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:29.091371 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:29.092007 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:29.092121 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:29.092808 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:29.092812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:29.092812 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:29.093013 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:29.093051 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:29.093066 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:29.093153 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:29.093236 (+ 83us) server_negotiation.cc:299] Negotiation successful
0924 17:37:29.093266 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":67,"threads_started":1}
I20260924 17:37:29.094405 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:29.099191 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:29.095804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51895 (local address 127.0.0.1:35459)
0924 17:37:29.095844 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:29.095846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:29.096007 (+ 161us) server_negotiation.cc:407] Connection header received
0924 17:37:29.096033 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:29.096033 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:29.096044 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:29.096109 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:29.096212 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:29.096926 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:29.097890 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:29.098200 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:29.098270 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:29.098940 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:29.098941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:29.098942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:29.098946 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:29.098960 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:29.098964 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:29.099023 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:29.099102 (+ 79us) server_negotiation.cc:299] Negotiation successful
0924 17:37:29.099114 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:29.101369 26970 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:29.101838 26970 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:29.108728 26970 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58a189bb169c47e296d78defdbfa3b15: Generated new TSK 0
I20260924 17:37:29.108918 26970 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:29.111413 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26879
W20260924 17:37:29.115572 26864 connection.cc:535] client connection to 127.0.0.1:35459 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35459): Connection reset by peer (error 104)
2026-09-24T17:37:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:29 dist-test-slave-gcz9 krb5kdc[26979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:29 dist-test-slave-gcz9 krb5kdc[26979](info): set up 2 sockets
Sep 24 17:37:29 dist-test-slave-gcz9 krb5kdc[26979](info): commencing operation
krb5kdc: starting...
W20260924 17:37:30.208729 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:30 dist-test-slave-gcz9 krb5kdc[26979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:30.325151 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40793
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37611
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:30.405104 26992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:30.405303 26992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:30.405325 26992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:30.406390 26992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:30.406423 26992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:30.406438 26992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:30.406450 26992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:30.406462 26992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:30.407894 26992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37611
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40793
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:30.408082 26992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:30.408244 26992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:30.413019 27000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:30.413048 26997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:30.413064 26992 server_base.cc:1034] running on GCE node
W20260924 17:37:30.413029 26998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:30.413476 26992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:30.413733 26992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:30.414902 26992 hybrid_clock.cc:648] HybridClock initialized: now 1790271450414854 us; error 34 us; skew 500 ppm
Sep 24 17:37:30 dist-test-slave-gcz9 krb5kdc[26979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271450, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:30.417264 26992 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:30.417639 26992 webserver.cc:460] Webserver started at http://127.0.0.1:39321/ using document root <none> and password file <none>
I20260924 17:37:30.417826 26992 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:30.417866 26992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:30.417955 26992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:30.419384 26992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "3b3050d207c04fa89ed1bb87874c1054"
format_stamp: "Formatted at 2026-09-24 17:37:30 on dist-test-slave-gcz9"
server_key: "dc1fd66c9daaea91ea82696304619dbb"
server_key_iv: "1be373a4304c1e515199048ea818e24b"
server_key_version: "encryptionkey@0"
I20260924 17:37:30.419839 26992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "3b3050d207c04fa89ed1bb87874c1054"
format_stamp: "Formatted at 2026-09-24 17:37:30 on dist-test-slave-gcz9"
server_key: "dc1fd66c9daaea91ea82696304619dbb"
server_key_iv: "1be373a4304c1e515199048ea818e24b"
server_key_version: "encryptionkey@0"
I20260924 17:37:30.421689 26992 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260924 17:37:30.422670 27007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:30.422886 26992 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:30.422982 26992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "3b3050d207c04fa89ed1bb87874c1054"
format_stamp: "Formatted at 2026-09-24 17:37:30 on dist-test-slave-gcz9"
server_key: "dc1fd66c9daaea91ea82696304619dbb"
server_key_iv: "1be373a4304c1e515199048ea818e24b"
server_key_version: "encryptionkey@0"
I20260924 17:37:30.423062 26992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:30.426474 26992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:30.428717 26992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:30.428867 26992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:30.432582 26992 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40793
I20260924 17:37:30.432626 27060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40793 every 8 connection(s)
I20260924 17:37:30.432943 26992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:30.433933 27061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:30.436256 27061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054: Bootstrap starting.
I20260924 17:37:30.436854 27061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:30.437141 27061 log.cc:824] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:30.437800 27061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054: No bootstrap required, opened a new log
I20260924 17:37:30.439581 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 26992
I20260924 17:37:30.439697 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:30.439563 27061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3050d207c04fa89ed1bb87874c1054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260924 17:37:30.439738 27061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:30.439785 27061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b3050d207c04fa89ed1bb87874c1054, State: Initialized, Role: FOLLOWER
I20260924 17:37:30.439905 6292 external_mini_cluster.cc:1428] Setting key f635fc46b780c0bbc0a843492e4bb791
I20260924 17:37:30.439939 27061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3050d207c04fa89ed1bb87874c1054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260924 17:37:30.440026 27061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:30.440069 27061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:30.440124 27061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:30.441210 27061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3050d207c04fa89ed1bb87874c1054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260924 17:37:30.441324 27061 leader_election.cc:302] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b3050d207c04fa89ed1bb87874c1054; no voters:
I20260924 17:37:30.441522 27061 leader_election.cc:288] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:30.441553 27067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:30.441740 27067 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [term 1 LEADER]: Becoming Leader. State: Replica: 3b3050d207c04fa89ed1bb87874c1054, State: Running, Role: LEADER
I20260924 17:37:30.441788 27061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:30.441875 27067 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3050d207c04fa89ed1bb87874c1054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260924 17:37:30.442430 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:30.440359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44815 (local address 127.0.0.1:40793)
0924 17:37:30.440641 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:30.440651 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:30.440686 (+ 35us) server_negotiation.cc:407] Connection header received
0924 17:37:30.440837 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:30.440845 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:30.440883 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:30.441040 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:30.441718 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:30.441721 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:30.441722 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:30.441727 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:30.441774 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:30.441789 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:30.442106 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:30.442138 (+ 32us) server_negotiation.cc:299] Negotiation successful
0924 17:37:30.442179 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":70,"threads_started":1}
I20260924 17:37:30.442276 27067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b3050d207c04fa89ed1bb87874c1054. Latest consensus state: current_term: 1 leader_uuid: "3b3050d207c04fa89ed1bb87874c1054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3050d207c04fa89ed1bb87874c1054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } } }
I20260924 17:37:30.442989 27067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:30.443214 27079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:30.443370 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:30.443333 27069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b3050d207c04fa89ed1bb87874c1054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b3050d207c04fa89ed1bb87874c1054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } } }
I20260924 17:37:30.443583 27069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:30.443809 27079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:30.445184 27079 catalog_manager.cc:1347] Generated new cluster ID: 7896f1ce954043978d3ca3c0c3101693
I20260924 17:37:30.445245 27079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:30.454294 27079 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:30.454437 27079 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:30.455186 27066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:30.447170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56871 (local address 127.0.0.1:40793)
0924 17:37:30.447204 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:30.447206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:30.454138 (+ 6932us) server_negotiation.cc:407] Connection header received
0924 17:37:30.454210 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:30.454211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:30.454217 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:30.454284 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:30.454951 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:30.454952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:30.454952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:30.454957 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:30.454972 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:30.454976 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:30.455029 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:30.455090 (+ 61us) server_negotiation.cc:299] Negotiation successful
0924 17:37:30.455104 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:30.461504 27079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b3050d207c04fa89ed1bb87874c1054: Generated new TSK 0
I20260924 17:37:30.461690 27079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:30.468806 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 26992
2026-09-24T17:37:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1358 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:30 dist-test-slave-gcz9 krb5kdc[27093](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:30 dist-test-slave-gcz9 krb5kdc[27093](info): set up 2 sockets
Sep 24 17:37:30 dist-test-slave-gcz9 krb5kdc[27093](info): commencing operation
krb5kdc: starting...
W20260924 17:37:31.504582 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:31 dist-test-slave-gcz9 krb5kdc[27093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:31.622499 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45647
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:31.707218 27107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:31.707419 27107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:31.707441 27107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:31.708534 27107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:31.708567 27107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:31.708581 27107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:31.708593 27107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:31.708606 27107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:31.710000 27107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:31.710186 27107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:31.710346 27107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:31.715077 27113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:31.715124 27116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:31.715155 27114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:31.715235 27107 server_base.cc:1034] running on GCE node
I20260924 17:37:31.715582 27107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:31.715898 27107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:31.717054 27107 hybrid_clock.cc:648] HybridClock initialized: now 1790271451717026 us; error 34 us; skew 500 ppm
Sep 24 17:37:31 dist-test-slave-gcz9 krb5kdc[27093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271451, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:31.719375 27107 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:31.719786 27107 webserver.cc:460] Webserver started at http://127.0.0.1:37981/ using document root <none> and password file <none>
I20260924 17:37:31.720007 27107 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:31.720075 27107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:31.720235 27107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:31.721253 27107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "a6d7e074099d472c9fb2a8471aab4f76"
format_stamp: "Formatted at 2026-09-24 17:37:31 on dist-test-slave-gcz9"
server_key: "8bd09d9780ac816b823fbc4f4930a830"
server_key_iv: "d4d29a5f57c4b785818c0bd0d003fcbe"
server_key_version: "encryptionkey@0"
I20260924 17:37:31.721608 27107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "a6d7e074099d472c9fb2a8471aab4f76"
format_stamp: "Formatted at 2026-09-24 17:37:31 on dist-test-slave-gcz9"
server_key: "8bd09d9780ac816b823fbc4f4930a830"
server_key_iv: "d4d29a5f57c4b785818c0bd0d003fcbe"
server_key_version: "encryptionkey@0"
I20260924 17:37:31.722913 27107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:37:31.723610 27123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:31.723780 27107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:31.723877 27107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "a6d7e074099d472c9fb2a8471aab4f76"
format_stamp: "Formatted at 2026-09-24 17:37:31 on dist-test-slave-gcz9"
server_key: "8bd09d9780ac816b823fbc4f4930a830"
server_key_iv: "d4d29a5f57c4b785818c0bd0d003fcbe"
server_key_version: "encryptionkey@0"
I20260924 17:37:31.723958 27107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:31.757382 27107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:31.759301 27107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:31.759500 27107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:31.763489 27107 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45647
I20260924 17:37:31.763518 27176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45647 every 8 connection(s)
I20260924 17:37:31.763875 27107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:31.764823 27177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:31.767151 27177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76: Bootstrap starting.
I20260924 17:37:31.767365 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27107
I20260924 17:37:31.767485 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:31.767652 6292 external_mini_cluster.cc:1428] Setting key a1fab7bdaa86ab41a8159665631a821a
I20260924 17:37:31.767848 27177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:31.768214 27177 log.cc:824] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:31.769023 27177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76: No bootstrap required, opened a new log
I20260924 17:37:31.771309 27177 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d7e074099d472c9fb2a8471aab4f76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45647 } }
I20260924 17:37:31.771494 27177 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:31.771544 27177 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6d7e074099d472c9fb2a8471aab4f76, State: Initialized, Role: FOLLOWER
I20260924 17:37:31.771672 27177 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d7e074099d472c9fb2a8471aab4f76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45647 } }
I20260924 17:37:31.771761 27177 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:31.771803 27177 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:31.771852 27177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:31.772472 27177 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d7e074099d472c9fb2a8471aab4f76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45647 } }
I20260924 17:37:31.772581 27177 leader_election.cc:302] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6d7e074099d472c9fb2a8471aab4f76; no voters:
I20260924 17:37:31.772732 27177 leader_election.cc:288] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:31.772840 27182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:31.772975 27177 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:31.773124 27182 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [term 1 LEADER]: Becoming Leader. State: Replica: a6d7e074099d472c9fb2a8471aab4f76, State: Running, Role: LEADER
I20260924 17:37:31.773243 27182 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d7e074099d472c9fb2a8471aab4f76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45647 } }
I20260924 17:37:31.773555 27182 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6d7e074099d472c9fb2a8471aab4f76. Latest consensus state: current_term: 1 leader_uuid: "a6d7e074099d472c9fb2a8471aab4f76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d7e074099d472c9fb2a8471aab4f76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45647 } } }
I20260924 17:37:31.773646 27182 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:31.773731 27183 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6d7e074099d472c9fb2a8471aab4f76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6d7e074099d472c9fb2a8471aab4f76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45647 } } }
I20260924 17:37:31.773873 27183 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:31.773994 27191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:31.774467 27191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 24 17:37:31 dist-test-slave-gcz9 krb5kdc[27093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271451, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 17:37:31.779275 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:31.768155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35179 (local address 127.0.0.1:45647)
0924 17:37:31.768350 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:31.768360 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:31.768392 (+ 32us) server_negotiation.cc:407] Connection header received
0924 17:37:31.768981 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:31.768990 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:31.769051 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:31.769200 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:31.769803 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:31.771277 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:31.772168 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:31.772825 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:31.773483 (+ 658us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:31.775956 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:31.775960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:31.775960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:31.775970 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:31.777641 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:31.778035 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:31.778037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:31.778037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:31.778119 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:31.778343 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:31.778344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:31.778344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:31.778585 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:31.778716 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:31.778846 (+ 130us) server_negotiation.cc:299] Negotiation successful
0924 17:37:31.779029 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":84,"threads_started":1}
I20260924 17:37:31.780274 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:31.783875 27191 catalog_manager.cc:1347] Generated new cluster ID: 32c3fdfc02034e6184fb152c6e4b82f6
I20260924 17:37:31.783926 27191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:31.788851 27180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:31.781799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36865 (local address 127.0.0.1:45647)
0924 17:37:31.781840 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:31.781842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:31.781916 (+ 74us) server_negotiation.cc:407] Connection header received
0924 17:37:31.781966 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:31.781967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:31.781976 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:31.782048 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:31.782510 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:31.783234 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:31.784260 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:31.784583 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:31.784626 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:31.786063 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:31.786065 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:31.786065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:31.786072 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:31.787632 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:31.788018 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:31.788020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:31.788020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:31.788072 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:31.788259 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:31.788260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:31.788260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:31.788378 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:31.788463 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:31.788684 (+ 221us) server_negotiation.cc:299] Negotiation successful
0924 17:37:31.788759 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260924 17:37:31.797376 27191 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:31.797930 27191 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:31.809502 27191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6d7e074099d472c9fb2a8471aab4f76: Generated new TSK 0
I20260924 17:37:31.809721 27191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:31.814388 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27107
2026-09-24T17:37:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1345 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:31 dist-test-slave-gcz9 krb5kdc[27208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:31 dist-test-slave-gcz9 krb5kdc[27208](info): set up 2 sockets
Sep 24 17:37:31 dist-test-slave-gcz9 krb5kdc[27208](info): commencing operation
krb5kdc: starting...
W20260924 17:37:32.876708 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:32 dist-test-slave-gcz9 krb5kdc[27208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:32.993780 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40787
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:33.072749 27221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:33.072999 27221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:33.073038 27221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:33.074193 27221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:33.074261 27221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:33.074285 27221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:33.074308 27221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:33.074335 27221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:33.075830 27221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:33.076109 27221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:33.076328 27221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:33.081161 27229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:33.081118 27226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:33.081089 27227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:33.081395 27221 server_base.cc:1034] running on GCE node
I20260924 17:37:33.081641 27221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:33.081869 27221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:33.083030 27221 hybrid_clock.cc:648] HybridClock initialized: now 1790271453083021 us; error 35 us; skew 500 ppm
Sep 24 17:37:33 dist-test-slave-gcz9 krb5kdc[27208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271453, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:33.086158 27221 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:33.086532 27221 webserver.cc:460] Webserver started at http://127.0.0.1:37291/ using document root <none> and password file <none>
I20260924 17:37:33.086706 27221 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:33.086745 27221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:33.086833 27221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:33.087895 27221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "f220ac6517fa4123ac9c2803c41f290b"
format_stamp: "Formatted at 2026-09-24 17:37:33 on dist-test-slave-gcz9"
server_key: "cf712d13d40c21d5fd1e59e4f0f8a1e7"
server_key_iv: "7ee9758bb875ff522e1e51064d929e68"
server_key_version: "encryptionkey@0"
I20260924 17:37:33.088202 27221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "f220ac6517fa4123ac9c2803c41f290b"
format_stamp: "Formatted at 2026-09-24 17:37:33 on dist-test-slave-gcz9"
server_key: "cf712d13d40c21d5fd1e59e4f0f8a1e7"
server_key_iv: "7ee9758bb875ff522e1e51064d929e68"
server_key_version: "encryptionkey@0"
I20260924 17:37:33.089411 27221 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:33.090035 27237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:33.090185 27221 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:33.090274 27221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "f220ac6517fa4123ac9c2803c41f290b"
format_stamp: "Formatted at 2026-09-24 17:37:33 on dist-test-slave-gcz9"
server_key: "cf712d13d40c21d5fd1e59e4f0f8a1e7"
server_key_iv: "7ee9758bb875ff522e1e51064d929e68"
server_key_version: "encryptionkey@0"
I20260924 17:37:33.090337 27221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:33.098853 27221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:33.101732 27221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:33.101836 27221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:33.105566 27221 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40787
I20260924 17:37:33.105647 27290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40787 every 8 connection(s)
I20260924 17:37:33.105973 27221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:33.106989 27291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:33.108151 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27221
I20260924 17:37:33.108247 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:33.108431 6292 external_mini_cluster.cc:1428] Setting key e55b0739fe260bffd73473cedad28bcd
I20260924 17:37:33.109573 27291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b: Bootstrap starting.
I20260924 17:37:33.110144 27291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:33.110430 27291 log.cc:824] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:33.111150 27291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b: No bootstrap required, opened a new log
I20260924 17:37:33.113026 27291 raft_consensus.cc:348] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f220ac6517fa4123ac9c2803c41f290b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40787 } }
I20260924 17:37:33.113200 27291 raft_consensus.cc:374] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:33.113245 27291 raft_consensus.cc:729] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f220ac6517fa4123ac9c2803c41f290b, State: Initialized, Role: FOLLOWER
I20260924 17:37:33.113447 27291 consensus_queue.cc:260] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f220ac6517fa4123ac9c2803c41f290b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40787 } }
I20260924 17:37:33.113554 27291 raft_consensus.cc:388] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:33.113590 27291 raft_consensus.cc:482] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:33.113685 27291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:33.114229 27291 raft_consensus.cc:504] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f220ac6517fa4123ac9c2803c41f290b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40787 } }
I20260924 17:37:33.114355 27291 leader_election.cc:302] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f220ac6517fa4123ac9c2803c41f290b; no voters:
I20260924 17:37:33.114532 27291 leader_election.cc:288] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:33.114678 27294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:33.108931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47071 (local address 127.0.0.1:40787)
0924 17:37:33.109112 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:33.109121 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:33.109152 (+ 31us) server_negotiation.cc:407] Connection header received
0924 17:37:33.109581 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:33.109587 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:33.109634 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:33.109781 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:33.110017 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:33.111045 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:33.111871 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:33.112299 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:33.112421 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:33.114066 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:33.114070 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:33.114070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:33.114227 (+ 157us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:33.114260 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:33.114271 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:33.114353 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:33.114437 (+ 84us) server_negotiation.cc:299] Negotiation successful
0924 17:37:33.114505 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260924 17:37:33.114850 27291 sys_catalog.cc:564] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:33.114984 27297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:33.115172 27297 raft_consensus.cc:686] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [term 1 LEADER]: Becoming Leader. State: Replica: f220ac6517fa4123ac9c2803c41f290b, State: Running, Role: LEADER
I20260924 17:37:33.115291 27297 consensus_queue.cc:237] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f220ac6517fa4123ac9c2803c41f290b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40787 } }
I20260924 17:37:33.115655 27297 sys_catalog.cc:455] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f220ac6517fa4123ac9c2803c41f290b. Latest consensus state: current_term: 1 leader_uuid: "f220ac6517fa4123ac9c2803c41f290b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f220ac6517fa4123ac9c2803c41f290b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40787 } } }
I20260924 17:37:33.115732 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:33.115666 27296 sys_catalog.cc:455] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f220ac6517fa4123ac9c2803c41f290b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f220ac6517fa4123ac9c2803c41f290b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40787 } } }
I20260924 17:37:33.115818 27297 sys_catalog.cc:458] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:33.115824 27296 sys_catalog.cc:458] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:33.116096 27307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:33.116719 27307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:33.118963 27307 catalog_manager.cc:1347] Generated new cluster ID: 440820e6d6e540129a6bed276f9801b0
I20260924 17:37:33.119046 27307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:33.121150 27294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:33.117268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36189 (local address 127.0.0.1:40787)
0924 17:37:33.117308 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:33.117310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:33.117436 (+ 126us) server_negotiation.cc:407] Connection header received
0924 17:37:33.117498 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:33.117499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:33.117509 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:33.117575 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:33.117705 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:33.118241 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:33.119204 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:33.119493 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:33.119580 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:33.120893 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:33.120894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:33.120894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:33.120899 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:33.120915 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:33.120920 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:33.120989 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:33.121044 (+ 55us) server_negotiation.cc:299] Negotiation successful
0924 17:37:33.121074 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260924 17:37:33.129042 27307 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:33.129628 27307 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:33.133190 27307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f220ac6517fa4123ac9c2803c41f290b: Generated new TSK 0
I20260924 17:37:33.133353 27307 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:33.140903 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27221
2026-09-24T17:37:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1326 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:33 dist-test-slave-gcz9 krb5kdc[27322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:33 dist-test-slave-gcz9 krb5kdc[27322](info): set up 2 sockets
Sep 24 17:37:33 dist-test-slave-gcz9 krb5kdc[27322](info): commencing operation
krb5kdc: starting...
W20260924 17:37:34.197388 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:34 dist-test-slave-gcz9 krb5kdc[27322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:34.311741 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35259
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35259
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:34.393143 27335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:34.393380 27335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:34.393422 27335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:34.394573 27335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:34.394641 27335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:34.394670 27335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:34.394701 27335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:34.394730 27335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:34.396237 27335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35259
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35259
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:34.396529 27335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:34.396749 27335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:34.401530 27341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:34.401602 27343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:34.401597 27340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:34.401746 27335 server_base.cc:1034] running on GCE node
I20260924 17:37:34.401947 27335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:34.402179 27335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:34.403314 27335 hybrid_clock.cc:648] HybridClock initialized: now 1790271454403299 us; error 26 us; skew 500 ppm
Sep 24 17:37:34 dist-test-slave-gcz9 krb5kdc[27322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271454, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:34.412645 27335 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:34.413127 27335 webserver.cc:460] Webserver started at http://127.0.0.1:40721/ using document root <none> and password file <none>
I20260924 17:37:34.413375 27335 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:34.413442 27335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:34.413589 27335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:34.414657 27335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "c07fbfe10622467d9a10c43936b5a851"
format_stamp: "Formatted at 2026-09-24 17:37:34 on dist-test-slave-gcz9"
server_key: "4f6249ab13925ff33d5517958240c4cc"
server_key_iv: "9405e51ea3a92761fcef82d8bbaf3f26"
server_key_version: "encryptionkey@0"
I20260924 17:37:34.415043 27335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "c07fbfe10622467d9a10c43936b5a851"
format_stamp: "Formatted at 2026-09-24 17:37:34 on dist-test-slave-gcz9"
server_key: "4f6249ab13925ff33d5517958240c4cc"
server_key_iv: "9405e51ea3a92761fcef82d8bbaf3f26"
server_key_version: "encryptionkey@0"
I20260924 17:37:34.416355 27335 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:37:34.417083 27350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:34.417254 27335 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:34.417336 27335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "c07fbfe10622467d9a10c43936b5a851"
format_stamp: "Formatted at 2026-09-24 17:37:34 on dist-test-slave-gcz9"
server_key: "4f6249ab13925ff33d5517958240c4cc"
server_key_iv: "9405e51ea3a92761fcef82d8bbaf3f26"
server_key_version: "encryptionkey@0"
I20260924 17:37:34.417407 27335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:34.420603 27335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:34.422341 27335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:34.422484 27335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:34.426218 27335 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35259
I20260924 17:37:34.426244 27403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35259 every 8 connection(s)
I20260924 17:37:34.426565 27335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:34.427546 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:34.429774 27404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851: Bootstrap starting.
I20260924 17:37:34.430402 27404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:34.430687 27404 log.cc:824] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:34.431393 27404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851: No bootstrap required, opened a new log
I20260924 17:37:34.432998 27404 raft_consensus.cc:348] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c07fbfe10622467d9a10c43936b5a851" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35259 } }
I20260924 17:37:34.433138 27404 raft_consensus.cc:374] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:34.433192 27404 raft_consensus.cc:729] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c07fbfe10622467d9a10c43936b5a851, State: Initialized, Role: FOLLOWER
I20260924 17:37:34.433346 27404 consensus_queue.cc:260] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c07fbfe10622467d9a10c43936b5a851" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35259 } }
I20260924 17:37:34.433429 27404 raft_consensus.cc:388] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:34.433481 27404 raft_consensus.cc:482] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:34.433533 27404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:34.434090 27404 raft_consensus.cc:504] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c07fbfe10622467d9a10c43936b5a851" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35259 } }
I20260924 17:37:34.434204 27404 leader_election.cc:302] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c07fbfe10622467d9a10c43936b5a851; no voters:
I20260924 17:37:34.434394 27404 leader_election.cc:288] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:34.434427 27407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:34.434607 27407 raft_consensus.cc:686] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [term 1 LEADER]: Becoming Leader. State: Replica: c07fbfe10622467d9a10c43936b5a851, State: Running, Role: LEADER
I20260924 17:37:34.434686 27404 sys_catalog.cc:564] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:34.434727 27407 consensus_queue.cc:237] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c07fbfe10622467d9a10c43936b5a851" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35259 } }
I20260924 17:37:34.435108 27409 sys_catalog.cc:455] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c07fbfe10622467d9a10c43936b5a851. Latest consensus state: current_term: 1 leader_uuid: "c07fbfe10622467d9a10c43936b5a851" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c07fbfe10622467d9a10c43936b5a851" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35259 } } }
I20260924 17:37:34.435238 27408 sys_catalog.cc:455] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c07fbfe10622467d9a10c43936b5a851" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c07fbfe10622467d9a10c43936b5a851" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35259 } } }
I20260924 17:37:34.435250 27409 sys_catalog.cc:458] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:34.435336 27408 sys_catalog.cc:458] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:34.435877 27418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:34.436354 27418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:34.436476 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27335
I20260924 17:37:34.436596 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:34.436751 6292 external_mini_cluster.cc:1428] Setting key 6548638139b875d9177f3dbfa86aeee6
I20260924 17:37:34.438136 27418 catalog_manager.cc:1347] Generated new cluster ID: 67408c3045ea422493e4b0759a26fcf6
I20260924 17:37:34.438208 27418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:34.439527 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:34.437216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32855 (local address 127.0.0.1:35259)
0924 17:37:34.437372 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:34.437382 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:34.437585 (+ 203us) server_negotiation.cc:407] Connection header received
0924 17:37:34.437724 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:34.437732 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:34.437763 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:34.437909 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:34.439101 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:34.439104 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:34.439104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:34.439107 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:34.439139 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:34.439151 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:34.439208 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:34.439321 (+ 113us) server_negotiation.cc:299] Negotiation successful
0924 17:37:34.439360 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260924 17:37:34.443912 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:34.446135 27418 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:34.446287 27418 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:34.447630 27426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:34.446401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37805 (local address 127.0.0.1:35259)
0924 17:37:34.446441 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:34.446443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:34.446684 (+ 241us) server_negotiation.cc:407] Connection header received
0924 17:37:34.446729 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:34.446730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:34.446736 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:34.446789 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:34.447418 (+ 629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:34.447420 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:34.447420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:34.447424 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:34.447440 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:34.447444 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:34.447494 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:34.447557 (+ 63us) server_negotiation.cc:299] Negotiation successful
0924 17:37:34.447570 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:34.449931 27418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c07fbfe10622467d9a10c43936b5a851: Generated new TSK 0
I20260924 17:37:34.450106 27418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:34.452180 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27335
2026-09-24T17:37:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1311 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:34 dist-test-slave-gcz9 krb5kdc[27435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:34 dist-test-slave-gcz9 krb5kdc[27435](info): set up 2 sockets
Sep 24 17:37:34 dist-test-slave-gcz9 krb5kdc[27435](info): commencing operation
krb5kdc: starting...
W20260924 17:37:35.504822 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:35 dist-test-slave-gcz9 krb5kdc[27435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:35.618016 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:35.704278 27448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:35.704507 27448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:35.704547 27448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:35.705685 27448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:35.705749 27448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:35.705775 27448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:35.705806 27448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:35.705834 27448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:35.707345 27448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:35.707614 27448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:35.707828 27448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:37:35.712668 27448 server_base.cc:1034] running on GCE node
W20260924 17:37:35.712631 27455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:35.712644 27454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:35.712621 27457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:35.713058 27448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:35.713330 27448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:35.714494 27448 hybrid_clock.cc:648] HybridClock initialized: now 1790271455714475 us; error 33 us; skew 500 ppm
Sep 24 17:37:35 dist-test-slave-gcz9 krb5kdc[27435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271455, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:35.716840 27448 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:35.717243 27448 webserver.cc:460] Webserver started at http://127.0.0.1:44583/ using document root <none> and password file <none>
I20260924 17:37:35.717453 27448 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:35.717515 27448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:35.717659 27448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:35.718641 27448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "731dc18ec921422abb22f72e90acedbd"
format_stamp: "Formatted at 2026-09-24 17:37:35 on dist-test-slave-gcz9"
server_key: "cb721aefd9fc5311ff9bbf41595a0b97"
server_key_iv: "6295fb20bb57d1d71cb40fb1c7095ffc"
server_key_version: "encryptionkey@0"
I20260924 17:37:35.719023 27448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "731dc18ec921422abb22f72e90acedbd"
format_stamp: "Formatted at 2026-09-24 17:37:35 on dist-test-slave-gcz9"
server_key: "cb721aefd9fc5311ff9bbf41595a0b97"
server_key_iv: "6295fb20bb57d1d71cb40fb1c7095ffc"
server_key_version: "encryptionkey@0"
I20260924 17:37:35.720283 27448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:35.720947 27464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:35.721117 27448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:35.721210 27448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "731dc18ec921422abb22f72e90acedbd"
format_stamp: "Formatted at 2026-09-24 17:37:35 on dist-test-slave-gcz9"
server_key: "cb721aefd9fc5311ff9bbf41595a0b97"
server_key_iv: "6295fb20bb57d1d71cb40fb1c7095ffc"
server_key_version: "encryptionkey@0"
I20260924 17:37:35.721287 27448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:35.750468 27448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:35.752377 27448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:35.752540 27448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:35.756381 27448 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45129
I20260924 17:37:35.756430 27517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45129 every 8 connection(s)
I20260924 17:37:35.756781 27448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:35.757787 27518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:35.760144 27518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd: Bootstrap starting.
I20260924 17:37:35.760739 27518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:35.761023 27518 log.cc:824] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:35.761698 27518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd: No bootstrap required, opened a new log
I20260924 17:37:35.762768 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27448
I20260924 17:37:35.762910 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:35.763089 6292 external_mini_cluster.cc:1428] Setting key e15830c5f3d6793bd5b1956b737021bd
I20260924 17:37:35.763533 27518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731dc18ec921422abb22f72e90acedbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260924 17:37:35.763763 27518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:35.763823 27518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 731dc18ec921422abb22f72e90acedbd, State: Initialized, Role: FOLLOWER
I20260924 17:37:35.763953 27518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731dc18ec921422abb22f72e90acedbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260924 17:37:35.764038 27518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:35.764078 27518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:35.764132 27518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:35.764966 27518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731dc18ec921422abb22f72e90acedbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260924 17:37:35.765089 27518 leader_election.cc:302] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 731dc18ec921422abb22f72e90acedbd; no voters:
I20260924 17:37:35.765249 27518 leader_election.cc:288] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:35.765301 27523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:35.765413 27523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [term 1 LEADER]: Becoming Leader. State: Replica: 731dc18ec921422abb22f72e90acedbd, State: Running, Role: LEADER
I20260924 17:37:35.765522 27518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:35.765550 27523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731dc18ec921422abb22f72e90acedbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260924 17:37:35.765973 27524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "731dc18ec921422abb22f72e90acedbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731dc18ec921422abb22f72e90acedbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } } }
I20260924 17:37:35.765977 27523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 731dc18ec921422abb22f72e90acedbd. Latest consensus state: current_term: 1 leader_uuid: "731dc18ec921422abb22f72e90acedbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731dc18ec921422abb22f72e90acedbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } } }
I20260924 17:37:35.766131 27524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:35.766163 27523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:35.766479 27532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:35.767028 27532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:35.768806 27532 catalog_manager.cc:1347] Generated new cluster ID: b2304e4ead8d4b2ea8bd8c574479ac41
I20260924 17:37:35.768873 27532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:37:35 dist-test-slave-gcz9 krb5kdc[27435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271455, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 17:37:35.774498 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:35.763575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:45611 (local address 127.0.0.1:45129)
0924 17:37:35.763758 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:35.763767 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:35.763800 (+ 33us) server_negotiation.cc:407] Connection header received
0924 17:37:35.763940 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:35.763948 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:35.764017 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:35.764167 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:35.764800 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:35.766004 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:35.767195 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:35.767781 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:35.767891 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:35.770694 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:35.770698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:35.770698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:35.770711 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:35.772731 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:35.773156 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:35.773160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:35.773160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:35.773286 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:35.773534 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:35.773535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:35.773535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:35.773861 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:35.774089 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:35.774184 (+ 95us) server_negotiation.cc:299] Negotiation successful
0924 17:37:35.774297 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":91,"threads_started":1}
I20260924 17:37:35.774720 27532 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:35.775336 27532 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:35.775619 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:35.782315 27532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 731dc18ec921422abb22f72e90acedbd: Generated new TSK 0
I20260924 17:37:35.782477 27532 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:35.784024 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:35.777126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:45737 (local address 127.0.0.1:45129)
0924 17:37:35.777159 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:35.777161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:35.777191 (+ 30us) server_negotiation.cc:407] Connection header received
0924 17:37:35.777211 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:35.777212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:35.777222 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:35.777269 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:35.777831 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:35.778623 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:35.779622 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:35.779980 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:35.780046 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:35.781331 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:35.781333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:35.781333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:35.781340 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:35.783008 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:35.783337 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:35.783338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:35.783339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:35.783397 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:35.783578 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:35.783579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:35.783579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:35.783698 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:35.783795 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:35.783868 (+ 73us) server_negotiation.cc:299] Negotiation successful
0924 17:37:35.783929 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260924 17:37:35.785806 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27448
W20260924 17:37:35.790222 27433 connection.cc:535] client connection to 127.0.0.1:45129 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45129): Connection reset by peer (error 104)
2026-09-24T17:37:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1333 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:35 dist-test-slave-gcz9 krb5kdc[27549](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:35 dist-test-slave-gcz9 krb5kdc[27549](info): set up 2 sockets
Sep 24 17:37:35 dist-test-slave-gcz9 krb5kdc[27549](info): commencing operation
krb5kdc: starting...
W20260924 17:37:36.828662 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:36 dist-test-slave-gcz9 krb5kdc[27549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:36.945421 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44999
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:37.024962 27563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:37.025156 27563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:37.025178 27563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:37.026229 27563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:37.026260 27563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:37.026274 27563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:37.026286 27563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:37.026298 27563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:37.027673 27563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:37.027851 27563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:37.028018 27563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:37.032752 27568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:37.032752 27571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:37.032825 27569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:37.032985 27563 server_base.cc:1034] running on GCE node
I20260924 17:37:37.033221 27563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:37.033448 27563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:37.034581 27563 hybrid_clock.cc:648] HybridClock initialized: now 1790271457034562 us; error 33 us; skew 500 ppm
Sep 24 17:37:37 dist-test-slave-gcz9 krb5kdc[27549](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271457, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:37.037005 27563 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:37.037444 27563 webserver.cc:460] Webserver started at http://127.0.0.1:45239/ using document root <none> and password file <none>
I20260924 17:37:37.037675 27563 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:37.037740 27563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:37.037880 27563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:37.038955 27563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "e96b57a61a7249f4b3e5aed19a4db1a4"
format_stamp: "Formatted at 2026-09-24 17:37:37 on dist-test-slave-gcz9"
server_key: "a6389634a04e696b9a973537ec206c8e"
server_key_iv: "a2eba35f4b40a3e6c1053ef5b2c926a3"
server_key_version: "encryptionkey@0"
I20260924 17:37:37.039304 27563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "e96b57a61a7249f4b3e5aed19a4db1a4"
format_stamp: "Formatted at 2026-09-24 17:37:37 on dist-test-slave-gcz9"
server_key: "a6389634a04e696b9a973537ec206c8e"
server_key_iv: "a2eba35f4b40a3e6c1053ef5b2c926a3"
server_key_version: "encryptionkey@0"
I20260924 17:37:37.040573 27563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260924 17:37:37.041260 27578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:37.041420 27563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:37.041525 27563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "e96b57a61a7249f4b3e5aed19a4db1a4"
format_stamp: "Formatted at 2026-09-24 17:37:37 on dist-test-slave-gcz9"
server_key: "a6389634a04e696b9a973537ec206c8e"
server_key_iv: "a2eba35f4b40a3e6c1053ef5b2c926a3"
server_key_version: "encryptionkey@0"
I20260924 17:37:37.041601 27563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:37.057643 27563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:37.059962 27563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:37.060122 27563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:37.064561 27563 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44999
I20260924 17:37:37.064595 27630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44999 every 8 connection(s)
I20260924 17:37:37.064947 27563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:37.065915 27631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:37.068364 27631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4: Bootstrap starting.
I20260924 17:37:37.068907 27631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:37.069140 27631 log.cc:824] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:37.069824 27631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4: No bootstrap required, opened a new log
I20260924 17:37:37.069942 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27563
I20260924 17:37:37.070060 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:37.070241 6292 external_mini_cluster.cc:1428] Setting key 8c12bc1e8a644341b0bd1f1dc60a46a4
I20260924 17:37:37.071852 27631 raft_consensus.cc:348] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44999 } }
I20260924 17:37:37.072026 27631 raft_consensus.cc:374] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:37.072067 27631 raft_consensus.cc:729] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e96b57a61a7249f4b3e5aed19a4db1a4, State: Initialized, Role: FOLLOWER
I20260924 17:37:37.072232 27631 consensus_queue.cc:260] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44999 } }
I20260924 17:37:37.072329 27631 raft_consensus.cc:388] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:37.072373 27631 raft_consensus.cc:482] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:37.072423 27631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:37.072947 27631 raft_consensus.cc:504] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44999 } }
I20260924 17:37:37.073053 27631 leader_election.cc:302] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e96b57a61a7249f4b3e5aed19a4db1a4; no voters:
I20260924 17:37:37.073230 27631 leader_election.cc:288] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:37.073258 27636 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:37.073362 27636 raft_consensus.cc:686] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [term 1 LEADER]: Becoming Leader. State: Replica: e96b57a61a7249f4b3e5aed19a4db1a4, State: Running, Role: LEADER
I20260924 17:37:37.073504 27631 sys_catalog.cc:564] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:37.073509 27636 consensus_queue.cc:237] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44999 } }
I20260924 17:37:37.073992 27638 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e96b57a61a7249f4b3e5aed19a4db1a4. Latest consensus state: current_term: 1 leader_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44999 } } }
I20260924 17:37:37.074141 27638 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:37.074558 27646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:37.075117 27646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:37.075372 27637 sys_catalog.cc:455] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e96b57a61a7249f4b3e5aed19a4db1a4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44999 } } }
I20260924 17:37:37.075510 27637 sys_catalog.cc:458] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:37.076730 27646 catalog_manager.cc:1347] Generated new cluster ID: ee08c8285edb4b8ab8bedb9dbf05524f
I20260924 17:37:37.076786 27646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:37.077294 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:37.070744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:51731 (local address 127.0.0.1:44999)
0924 17:37:37.070938 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:37.070946 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:37.070972 (+ 26us) server_negotiation.cc:407] Connection header received
0924 17:37:37.071830 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:37.071836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:37.071885 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:37.071997 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:37.072292 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:37.073768 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:37.074950 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:37.075537 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:37.075656 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:37.076564 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:37.076567 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:37.076568 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:37.076787 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:37.076829 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:37.076856 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:37.076941 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:37.077071 (+ 130us) server_negotiation.cc:299] Negotiation successful
0924 17:37:37.077098 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":78,"threads_started":1}
I20260924 17:37:37.078287 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:37.083185 27635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:37.079706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:44361 (local address 127.0.0.1:44999)
0924 17:37:37.079746 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:37.079748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:37.079888 (+ 140us) server_negotiation.cc:407] Connection header received
0924 17:37:37.079965 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:37.079966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:37.079983 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:37.080011 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:37.080177 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:37.080868 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:37.081834 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:37.082134 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:37.082168 (+ 34us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:37.082920 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:37.082922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:37.082922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:37.082926 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:37.082939 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:37.082943 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:37.082971 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:37.083086 (+ 115us) server_negotiation.cc:299] Negotiation successful
0924 17:37:37.083099 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260924 17:37:37.089043 27646 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:37.089588 27646 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:37.095108 27646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e96b57a61a7249f4b3e5aed19a4db1a4: Generated new TSK 0
I20260924 17:37:37.095263 27646 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:37.097151 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27563
W20260924 17:37:37.101801 27547 connection.cc:535] client connection to 127.0.0.1:44999 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44999): Connection reset by peer (error 104)
2026-09-24T17:37:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1311 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:37 dist-test-slave-gcz9 krb5kdc[27663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:37 dist-test-slave-gcz9 krb5kdc[27663](info): set up 2 sockets
Sep 24 17:37:37 dist-test-slave-gcz9 krb5kdc[27663](info): commencing operation
krb5kdc: starting...
W20260924 17:37:38.188635 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:38 dist-test-slave-gcz9 krb5kdc[27663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:38.303574 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42755
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:38.385181 27676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:38.385370 27676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:38.385392 27676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:38.386528 27676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:38.386569 27676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:38.386583 27676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:38.386618 27676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:38.386646 27676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:38.388257 27676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:38.388500 27676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:38.388724 27676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:38.393658 27681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:38.393704 27682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:38.393733 27676 server_base.cc:1034] running on GCE node
W20260924 17:37:38.393671 27684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:38.394027 27676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:38.394299 27676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:38.395448 27676 hybrid_clock.cc:648] HybridClock initialized: now 1790271458395439 us; error 34 us; skew 500 ppm
Sep 24 17:37:38 dist-test-slave-gcz9 krb5kdc[27663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271458, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:38.397938 27676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:38.398362 27676 webserver.cc:460] Webserver started at http://127.0.0.1:36291/ using document root <none> and password file <none>
I20260924 17:37:38.398594 27676 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:38.398659 27676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:38.398801 27676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:38.399837 27676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "878a35714bde44a3854b953167599af5"
format_stamp: "Formatted at 2026-09-24 17:37:38 on dist-test-slave-gcz9"
server_key: "c2ecfdd5961e547f4578d99f069a4f09"
server_key_iv: "9baba78ffce95f83d5354e31c0baa3b6"
server_key_version: "encryptionkey@0"
I20260924 17:37:38.400197 27676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "878a35714bde44a3854b953167599af5"
format_stamp: "Formatted at 2026-09-24 17:37:38 on dist-test-slave-gcz9"
server_key: "c2ecfdd5961e547f4578d99f069a4f09"
server_key_iv: "9baba78ffce95f83d5354e31c0baa3b6"
server_key_version: "encryptionkey@0"
I20260924 17:37:38.401463 27676 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:38.402211 27691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:38.402374 27676 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:38.402467 27676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "878a35714bde44a3854b953167599af5"
format_stamp: "Formatted at 2026-09-24 17:37:38 on dist-test-slave-gcz9"
server_key: "c2ecfdd5961e547f4578d99f069a4f09"
server_key_iv: "9baba78ffce95f83d5354e31c0baa3b6"
server_key_version: "encryptionkey@0"
I20260924 17:37:38.402544 27676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:38.405730 27676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:38.407830 27676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:38.407971 27676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:38.411705 27676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42755
I20260924 17:37:38.411741 27744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42755 every 8 connection(s)
I20260924 17:37:38.412046 27676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:38.413004 27745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:38.415292 27745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5: Bootstrap starting.
I20260924 17:37:38.415864 27745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:38.416160 27745 log.cc:824] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:38.416812 27745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5: No bootstrap required, opened a new log
I20260924 17:37:38.417912 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27676
I20260924 17:37:38.418042 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:38.418202 6292 external_mini_cluster.cc:1428] Setting key e8c6d7ffbc347e556f52f3b52cb06523
I20260924 17:37:38.418561 27745 raft_consensus.cc:348] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878a35714bde44a3854b953167599af5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260924 17:37:38.418751 27745 raft_consensus.cc:374] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:38.418829 27745 raft_consensus.cc:729] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 878a35714bde44a3854b953167599af5, State: Initialized, Role: FOLLOWER
I20260924 17:37:38.419013 27745 consensus_queue.cc:260] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878a35714bde44a3854b953167599af5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260924 17:37:38.419095 27745 raft_consensus.cc:388] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:38.419118 27745 raft_consensus.cc:482] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:38.419181 27745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:38.420308 27745 raft_consensus.cc:504] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878a35714bde44a3854b953167599af5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260924 17:37:38.420331 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:38.418697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:43611 (local address 127.0.0.1:42755)
0924 17:37:38.418913 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:38.418922 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:38.418956 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:37:38.419071 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:38.419076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:38.419117 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:38.419251 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:38.419888 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:38.419891 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:38.419891 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:38.419895 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:38.419938 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:38.419949 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:38.420004 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:38.420086 (+ 82us) server_negotiation.cc:299] Negotiation successful
0924 17:37:38.420137 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":98,"threads_started":1}
I20260924 17:37:38.420423 27745 leader_election.cc:302] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 878a35714bde44a3854b953167599af5; no voters:
I20260924 17:37:38.420598 27745 leader_election.cc:288] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:38.420650 27750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:38.420779 27750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [term 1 LEADER]: Becoming Leader. State: Replica: 878a35714bde44a3854b953167599af5, State: Running, Role: LEADER
I20260924 17:37:38.420835 27745 sys_catalog.cc:564] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:38.420899 27750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878a35714bde44a3854b953167599af5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260924 17:37:38.421209 27750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 878a35714bde44a3854b953167599af5. Latest consensus state: current_term: 1 leader_uuid: "878a35714bde44a3854b953167599af5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878a35714bde44a3854b953167599af5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } } }
I20260924 17:37:38.421314 27750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:38.421226 27752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "878a35714bde44a3854b953167599af5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878a35714bde44a3854b953167599af5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } } }
I20260924 17:37:38.421396 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:38.421435 27752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:38.421768 27757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:38.422290 27757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:38.423980 27757 catalog_manager.cc:1347] Generated new cluster ID: c353c5ff0b6f49bab27137d8115ce419
I20260924 17:37:38.424029 27757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:38.427973 27749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:38.423002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:58195 (local address 127.0.0.1:42755)
0924 17:37:38.423037 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:38.423039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:38.427069 (+ 4030us) server_negotiation.cc:407] Connection header received
0924 17:37:38.427141 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:38.427142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:38.427147 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:38.427203 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:38.427758 (+ 555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:38.427760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:38.427760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:38.427764 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:38.427778 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:38.427782 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:38.427832 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:38.427891 (+ 59us) server_negotiation.cc:299] Negotiation successful
0924 17:37:38.427903 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:38.432322 27757 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:38.432471 27757 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:38.438508 27757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 878a35714bde44a3854b953167599af5: Generated new TSK 0
I20260924 17:37:38.438691 27757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:38.444083 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27676
2026-09-24T17:37:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1346 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:38 dist-test-slave-gcz9 krb5kdc[27777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:38 dist-test-slave-gcz9 krb5kdc[27777](info): set up 2 sockets
Sep 24 17:37:38 dist-test-slave-gcz9 krb5kdc[27777](info): commencing operation
krb5kdc: starting...
W20260924 17:37:39.492794 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:39 dist-test-slave-gcz9 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:39.607200 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40747
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:39.686236 27790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:39.686457 27790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:39.686504 27790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:39.687798 27790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:39.687858 27790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:39.687883 27790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:39.687911 27790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:39.687933 27790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:39.690340 27790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40747
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27790
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:39.690621 27790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:39.690851 27790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:37:39.696112 27790 server_base.cc:1034] running on GCE node
W20260924 17:37:39.696112 27796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:39.696233 27798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:39.696168 27795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:39.696480 27790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:39.696797 27790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:39.697956 27790 hybrid_clock.cc:648] HybridClock initialized: now 1790271459697938 us; error 35 us; skew 500 ppm
Sep 24 17:37:39 dist-test-slave-gcz9 krb5kdc[27777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271459, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:39.711262 27790 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:39.711726 27790 webserver.cc:460] Webserver started at http://127.0.0.1:42971/ using document root <none> and password file <none>
I20260924 17:37:39.711931 27790 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:39.711971 27790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:39.712061 27790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:39.713065 27790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "17513ad9b929410e98c6f21c8e02c45b"
format_stamp: "Formatted at 2026-09-24 17:37:39 on dist-test-slave-gcz9"
server_key: "459f5695e4ee2e1e2bca66ea39707cd1"
server_key_iv: "de5c4ea51631064a39d9377f6771087d"
server_key_version: "encryptionkey@0"
I20260924 17:37:39.713368 27790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "17513ad9b929410e98c6f21c8e02c45b"
format_stamp: "Formatted at 2026-09-24 17:37:39 on dist-test-slave-gcz9"
server_key: "459f5695e4ee2e1e2bca66ea39707cd1"
server_key_iv: "de5c4ea51631064a39d9377f6771087d"
server_key_version: "encryptionkey@0"
I20260924 17:37:39.714588 27790 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:39.715303 27805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:39.715466 27790 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:39.715557 27790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "17513ad9b929410e98c6f21c8e02c45b"
format_stamp: "Formatted at 2026-09-24 17:37:39 on dist-test-slave-gcz9"
server_key: "459f5695e4ee2e1e2bca66ea39707cd1"
server_key_iv: "de5c4ea51631064a39d9377f6771087d"
server_key_version: "encryptionkey@0"
I20260924 17:37:39.715615 27790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:39.732231 27790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:39.733951 27790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:39.734068 27790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:39.737955 27790 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40747
I20260924 17:37:39.738031 27858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40747 every 8 connection(s)
I20260924 17:37:39.738358 27790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:39.739405 27859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:39.741268 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27790
I20260924 17:37:39.741351 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:39.741541 6292 external_mini_cluster.cc:1428] Setting key 6fb57cbfcec4043401e04cc0135a56fb
I20260924 17:37:39.741786 27859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b: Bootstrap starting.
I20260924 17:37:39.742547 27859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:39.742889 27859 log.cc:824] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:39.743618 27859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b: No bootstrap required, opened a new log
I20260924 17:37:39.745898 27859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17513ad9b929410e98c6f21c8e02c45b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40747 } }
I20260924 17:37:39.746083 27859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:39.746117 27859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17513ad9b929410e98c6f21c8e02c45b, State: Initialized, Role: FOLLOWER
I20260924 17:37:39.746238 27859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17513ad9b929410e98c6f21c8e02c45b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40747 } }
I20260924 17:37:39.746310 27859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:39.746340 27859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:39.746382 27859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:39.747103 27859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17513ad9b929410e98c6f21c8e02c45b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40747 } }
I20260924 17:37:39.747215 27859 leader_election.cc:302] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17513ad9b929410e98c6f21c8e02c45b; no voters:
I20260924 17:37:39.747399 27859 leader_election.cc:288] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:39.747424 27864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:39.747556 27864 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [term 1 LEADER]: Becoming Leader. State: Replica: 17513ad9b929410e98c6f21c8e02c45b, State: Running, Role: LEADER
I20260924 17:37:39.747637 27864 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17513ad9b929410e98c6f21c8e02c45b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40747 } }
I20260924 17:37:39.747661 27859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:39.748143 27865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17513ad9b929410e98c6f21c8e02c45b. Latest consensus state: current_term: 1 leader_uuid: "17513ad9b929410e98c6f21c8e02c45b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17513ad9b929410e98c6f21c8e02c45b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40747 } } }
I20260924 17:37:39.748274 27865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:39.748771 27870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 24 17:37:39 dist-test-slave-gcz9 krb5kdc[27777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260924 17:37:39.749254 27870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:39.749577 27866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17513ad9b929410e98c6f21c8e02c45b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17513ad9b929410e98c6f21c8e02c45b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40747 } } }
I20260924 17:37:39.749701 27866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:39.750864 27870 catalog_manager.cc:1347] Generated new cluster ID: c922e9365d6145a8b7652c0a479ff1da
I20260924 17:37:39.750936 27870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:39.753486 27862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:39.742061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:34231 (local address 127.0.0.1:40747)
0924 17:37:39.742259 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:39.742271 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:39.742309 (+ 38us) server_negotiation.cc:407] Connection header received
0924 17:37:39.743010 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:39.743021 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:39.743091 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:39.743216 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:39.743894 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:39.745261 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:39.745984 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:39.746600 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:39.746713 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:39.749769 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:39.749774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:39.749774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:39.749787 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:39.751746 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:39.752176 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:39.752179 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:39.752180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:39.752277 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:39.752497 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:39.752498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:39.752499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:39.752773 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:39.752902 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:39.753174 (+ 272us) server_negotiation.cc:299] Negotiation successful
0924 17:37:39.753271 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260924 17:37:39.754703 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:39.763411 27862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:39.756126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:58937 (local address 127.0.0.1:40747)
0924 17:37:39.756158 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:39.756160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:39.756268 (+ 108us) server_negotiation.cc:407] Connection header received
0924 17:37:39.756331 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:39.756332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:39.756342 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:39.756399 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:39.756996 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:39.757759 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:39.758777 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:39.759112 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:39.759172 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:39.760606 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:39.760607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:39.760608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:39.760614 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:39.762190 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:39.762600 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:39.762601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:39.762601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:39.762654 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:39.762890 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:39.762890 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:39.762891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:39.763000 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:39.763100 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:39.763249 (+ 149us) server_negotiation.cc:299] Negotiation successful
0924 17:37:39.763326 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":15}
I20260924 17:37:39.784075 27870 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:39.784586 27870 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:39.793471 27870 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17513ad9b929410e98c6f21c8e02c45b: Generated new TSK 0
I20260924 17:37:39.793650 27870 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:39.802964 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27790
W20260924 17:37:39.808001 27775 connection.cc:535] client connection to 127.0.0.1:40747 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40747): Connection reset by peer (error 104)
2026-09-24T17:37:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1359 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:39 dist-test-slave-gcz9 krb5kdc[27890](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:39 dist-test-slave-gcz9 krb5kdc[27890](info): set up 2 sockets
Sep 24 17:37:39 dist-test-slave-gcz9 krb5kdc[27890](info): commencing operation
krb5kdc: starting...
W20260924 17:37:40.860740 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:40 dist-test-slave-gcz9 krb5kdc[27890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:40.977361 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41571
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:41.057269 27903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:41.057518 27903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:41.057559 27903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:41.058700 27903 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:41.058775 27903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:41.058799 27903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:41.058820 27903 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:41.058851 27903 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:41.060298 27903 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41571
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:41.060575 27903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:41.060799 27903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:41.065594 27908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:41.065582 27909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:41.065582 27911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:41.065763 27903 server_base.cc:1034] running on GCE node
I20260924 17:37:41.066107 27903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:41.066378 27903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:41.067538 27903 hybrid_clock.cc:648] HybridClock initialized: now 1790271461067530 us; error 57 us; skew 500 ppm
Sep 24 17:37:41 dist-test-slave-gcz9 krb5kdc[27890](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271461, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:41.069856 27903 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:41.070264 27903 webserver.cc:460] Webserver started at http://127.0.0.1:34113/ using document root <none> and password file <none>
I20260924 17:37:41.070478 27903 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:41.070549 27903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:41.070693 27903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:41.071780 27903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "3c16844720ac49f3bcb069985dbba402"
format_stamp: "Formatted at 2026-09-24 17:37:41 on dist-test-slave-gcz9"
server_key: "858dbbee1d4a5c5f64aca15e6df5051e"
server_key_iv: "9116bb0ef5244015134f8508f83eaaad"
server_key_version: "encryptionkey@0"
I20260924 17:37:41.072151 27903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "3c16844720ac49f3bcb069985dbba402"
format_stamp: "Formatted at 2026-09-24 17:37:41 on dist-test-slave-gcz9"
server_key: "858dbbee1d4a5c5f64aca15e6df5051e"
server_key_iv: "9116bb0ef5244015134f8508f83eaaad"
server_key_version: "encryptionkey@0"
I20260924 17:37:41.073424 27903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:41.074126 27918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:41.074304 27903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:41.074404 27903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "3c16844720ac49f3bcb069985dbba402"
format_stamp: "Formatted at 2026-09-24 17:37:41 on dist-test-slave-gcz9"
server_key: "858dbbee1d4a5c5f64aca15e6df5051e"
server_key_iv: "9116bb0ef5244015134f8508f83eaaad"
server_key_version: "encryptionkey@0"
I20260924 17:37:41.074488 27903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:41.101006 27903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:41.102942 27903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:41.103114 27903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:41.106988 27903 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41571
I20260924 17:37:41.107048 27971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41571 every 8 connection(s)
I20260924 17:37:41.107405 27903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:41.108361 27972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:41.110729 27972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402: Bootstrap starting.
I20260924 17:37:41.111374 27972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:41.111691 27972 log.cc:824] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:41.112001 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 27903
I20260924 17:37:41.112120 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:41.112306 6292 external_mini_cluster.cc:1428] Setting key afa791c4376076754e868b7447df2f34
I20260924 17:37:41.112474 27972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402: No bootstrap required, opened a new log
I20260924 17:37:41.115396 27972 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c16844720ac49f3bcb069985dbba402" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41571 } }
I20260924 17:37:41.115562 27972 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:41.115592 27972 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c16844720ac49f3bcb069985dbba402, State: Initialized, Role: FOLLOWER
I20260924 17:37:41.115711 27972 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c16844720ac49f3bcb069985dbba402" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41571 } }
I20260924 17:37:41.115823 27972 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:41.115857 27972 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:41.115906 27972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:41.116434 27972 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c16844720ac49f3bcb069985dbba402" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41571 } }
I20260924 17:37:41.116549 27972 leader_election.cc:302] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c16844720ac49f3bcb069985dbba402; no voters:
I20260924 17:37:41.116706 27972 leader_election.cc:288] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:41.116732 27977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:41.116904 27977 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [term 1 LEADER]: Becoming Leader. State: Replica: 3c16844720ac49f3bcb069985dbba402, State: Running, Role: LEADER
I20260924 17:37:41.116981 27972 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:41.117038 27977 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c16844720ac49f3bcb069985dbba402" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41571 } }
I20260924 17:37:41.117482 27977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c16844720ac49f3bcb069985dbba402. Latest consensus state: current_term: 1 leader_uuid: "3c16844720ac49f3bcb069985dbba402" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c16844720ac49f3bcb069985dbba402" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41571 } } }
I20260924 17:37:41.117621 27977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:41.117585 27979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c16844720ac49f3bcb069985dbba402" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c16844720ac49f3bcb069985dbba402" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41571 } } }
I20260924 17:37:41.117740 27979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:41.117939 27986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:41.118516 27986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:41.119241 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:41.112807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:53677 (local address 127.0.0.1:41571)
0924 17:37:41.113026 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:41.113036 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:41.113069 (+ 33us) server_negotiation.cc:407] Connection header received
0924 17:37:41.113850 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:41.113860 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:41.113926 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:41.114085 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:41.114317 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:41.115699 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:41.116591 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:41.117225 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:41.118153 (+ 928us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:41.118311 (+ 158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:41.118315 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:41.118315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:41.118513 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:41.118554 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:41.118571 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:41.118909 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:41.118956 (+ 47us) server_negotiation.cc:299] Negotiation successful
0924 17:37:41.119018 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260924 17:37:41.120157 27986 catalog_manager.cc:1347] Generated new cluster ID: 2e80e8f7ca434b99840d914efeb69304
I20260924 17:37:41.120205 27986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:41.120247 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:41.124531 27976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:41.121589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:39801 (local address 127.0.0.1:41571)
0924 17:37:41.121624 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:41.121626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:41.121746 (+ 120us) server_negotiation.cc:407] Connection header received
0924 17:37:41.121818 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:41.121818 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:41.121828 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:41.121871 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:41.122026 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:41.122529 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:41.123325 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:41.123544 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:41.123627 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:41.124298 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:41.124299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:41.124299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:41.124304 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:41.124318 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:41.124322 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:41.124374 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:41.124433 (+ 59us) server_negotiation.cc:299] Negotiation successful
0924 17:37:41.124441 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:41.129326 27986 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:41.129987 27986 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:41.134765 27986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c16844720ac49f3bcb069985dbba402: Generated new TSK 0
I20260924 17:37:41.134958 27986 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:41.138875 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 27903
W20260924 17:37:41.143488 27888 connection.cc:535] client connection to 127.0.0.1:41571 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41571): Connection reset by peer (error 104)
2026-09-24T17:37:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1335 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:41 dist-test-slave-gcz9 krb5kdc[28003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:41 dist-test-slave-gcz9 krb5kdc[28003](info): set up 2 sockets
Sep 24 17:37:41 dist-test-slave-gcz9 krb5kdc[28003](info): commencing operation
krb5kdc: starting...
W20260924 17:37:42.260761 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:42 dist-test-slave-gcz9 krb5kdc[28003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271462, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260924 17:37:42.376048 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38213
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:42.458683 28017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:42.458951 28017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:42.458992 28017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:42.460151 28017 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:42.460223 28017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:42.460247 28017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:42.460270 28017 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:42.460305 28017 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:42.461774 28017 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38213
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:42.462054 28017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:42.462283 28017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:42.467105 28025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:42.467114 28022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:42.467314 28017 server_base.cc:1034] running on GCE node
W20260924 17:37:42.467121 28023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:42.467612 28017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:42.467898 28017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:42.469067 28017 hybrid_clock.cc:648] HybridClock initialized: now 1790271462469059 us; error 47 us; skew 500 ppm
Sep 24 17:37:42 dist-test-slave-gcz9 krb5kdc[28003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271462, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:42.471575 28017 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260924 17:37:42.471993 28017 webserver.cc:460] Webserver started at http://127.0.0.1:37765/ using document root <none> and password file <none>
I20260924 17:37:42.472229 28017 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:42.472295 28017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:42.472445 28017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:42.473500 28017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "675f804bc594468cb2ade5d59bb570c6"
format_stamp: "Formatted at 2026-09-24 17:37:42 on dist-test-slave-gcz9"
server_key: "33b92c5735664c270abc40d6513e7dc8"
server_key_iv: "61076649095d5ddaad0035b3212ceb6a"
server_key_version: "encryptionkey@0"
I20260924 17:37:42.473862 28017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "675f804bc594468cb2ade5d59bb570c6"
format_stamp: "Formatted at 2026-09-24 17:37:42 on dist-test-slave-gcz9"
server_key: "33b92c5735664c270abc40d6513e7dc8"
server_key_iv: "61076649095d5ddaad0035b3212ceb6a"
server_key_version: "encryptionkey@0"
I20260924 17:37:42.475199 28017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:42.475924 28032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:42.476090 28017 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:42.476195 28017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "675f804bc594468cb2ade5d59bb570c6"
format_stamp: "Formatted at 2026-09-24 17:37:42 on dist-test-slave-gcz9"
server_key: "33b92c5735664c270abc40d6513e7dc8"
server_key_iv: "61076649095d5ddaad0035b3212ceb6a"
server_key_version: "encryptionkey@0"
I20260924 17:37:42.476269 28017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:42.479559 28017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:42.481804 28017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:42.481957 28017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:42.485771 28017 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38213
I20260924 17:37:42.485834 28085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38213 every 8 connection(s)
I20260924 17:37:42.486160 28017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:42.487181 28086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:42.489315 28086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6: Bootstrap starting.
I20260924 17:37:42.489871 28086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:42.490151 28086 log.cc:824] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:42.490502 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28017
I20260924 17:37:42.490625 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:42.490808 6292 external_mini_cluster.cc:1428] Setting key 1993067d1f4c660d20966afc7b1457e2
I20260924 17:37:42.490939 28086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6: No bootstrap required, opened a new log
I20260924 17:37:42.493230 28086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675f804bc594468cb2ade5d59bb570c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38213 } }
I20260924 17:37:42.493363 28086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:42.493383 28086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675f804bc594468cb2ade5d59bb570c6, State: Initialized, Role: FOLLOWER
I20260924 17:37:42.493570 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:42.491316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:38557 (local address 127.0.0.1:38213)
0924 17:37:42.491508 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:42.491516 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:42.491539 (+ 23us) server_negotiation.cc:407] Connection header received
0924 17:37:42.492179 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:42.492186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:42.492211 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:42.492321 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:42.492924 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:42.492927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:42.492927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:42.492931 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:42.492970 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:42.492983 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:42.493037 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:42.493113 (+ 76us) server_negotiation.cc:299] Negotiation successful
0924 17:37:42.493170 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
I20260924 17:37:42.493520 28086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675f804bc594468cb2ade5d59bb570c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38213 } }
I20260924 17:37:42.493695 28086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:42.493741 28086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:42.493793 28086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:42.494511 28086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675f804bc594468cb2ade5d59bb570c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38213 } }
I20260924 17:37:42.494581 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:42.494620 28086 leader_election.cc:302] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 675f804bc594468cb2ade5d59bb570c6; no voters:
I20260924 17:37:42.494765 28086 leader_election.cc:288] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:42.494814 28091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:42.495004 28091 raft_consensus.cc:686] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [term 1 LEADER]: Becoming Leader. State: Replica: 675f804bc594468cb2ade5d59bb570c6, State: Running, Role: LEADER
I20260924 17:37:42.495038 28086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:42.495164 28091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675f804bc594468cb2ade5d59bb570c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38213 } }
I20260924 17:37:42.495535 28091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 675f804bc594468cb2ade5d59bb570c6. Latest consensus state: current_term: 1 leader_uuid: "675f804bc594468cb2ade5d59bb570c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675f804bc594468cb2ade5d59bb570c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38213 } } }
I20260924 17:37:42.495545 28092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "675f804bc594468cb2ade5d59bb570c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "675f804bc594468cb2ade5d59bb570c6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38213 } } }
I20260924 17:37:42.495659 28091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:42.495676 28092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:42.496373 28103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:42.496853 28103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:42.498400 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:42.497453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.128:51193 (local address 127.0.0.1:38213)
0924 17:37:42.497505 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:42.497507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:42.497513 (+ 6us) server_negotiation.cc:407] Connection header received
0924 17:37:42.497529 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:42.497529 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:42.497532 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:42.497590 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:42.498188 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:42.498190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:42.498190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:42.498194 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:42.498209 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:42.498213 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:42.498276 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:42.498336 (+ 60us) server_negotiation.cc:299] Negotiation successful
0924 17:37:42.498348 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 17:37:42.498735 28103 catalog_manager.cc:1347] Generated new cluster ID: a8b9c689a8e54ce9b1302feb559b88b8
I20260924 17:37:42.498780 28103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:42.523900 28103 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:42.524106 28103 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:42.531831 28103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 675f804bc594468cb2ade5d59bb570c6: Generated new TSK 0
I20260924 17:37:42.532037 28103 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:42.542846 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28017
2026-09-24T17:37:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1404 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:42 dist-test-slave-gcz9 krb5kdc[28117](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:42 dist-test-slave-gcz9 krb5kdc[28117](info): set up 2 sockets
Sep 24 17:37:42 dist-test-slave-gcz9 krb5kdc[28117](info): commencing operation
krb5kdc: starting...
W20260924 17:37:43.600670 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:43 dist-test-slave-gcz9 krb5kdc[28117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:43.717533 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:35359
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:35183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:35359
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:43.798017 28130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:43.798220 28130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:43.798242 28130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:43.799419 28130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:43.799461 28130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:43.799475 28130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:43.799527 28130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:43.799546 28130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:43.801015 28130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:35183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:35359
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:35359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:43.801265 28130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:43.801502 28130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:43.806318 28135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:43.806318 28138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:43.806595 28130 server_base.cc:1034] running on GCE node
W20260924 17:37:43.806679 28136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:43.806954 28130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:43.807240 28130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:43.808393 28130 hybrid_clock.cc:648] HybridClock initialized: now 1790271463808373 us; error 38 us; skew 500 ppm
Sep 24 17:37:43 dist-test-slave-gcz9 krb5kdc[28117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271463, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:43.810747 28130 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:43.811185 28130 webserver.cc:460] Webserver started at http://127.6.37.62:32881/ using document root <none> and password file <none>
I20260924 17:37:43.811379 28130 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:43.811419 28130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:43.811528 28130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:43.812482 28130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "bed71516b98a4f48aaa68a63f561e63e"
format_stamp: "Formatted at 2026-09-24 17:37:43 on dist-test-slave-gcz9"
server_key: "8ebcd28ad458675e43e46270b6ecb6a8"
server_key_iv: "3469f62d87ee6b78f08b3ec7dbcbda55"
server_key_version: "encryptionkey@0"
I20260924 17:37:43.812779 28130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "bed71516b98a4f48aaa68a63f561e63e"
format_stamp: "Formatted at 2026-09-24 17:37:43 on dist-test-slave-gcz9"
server_key: "8ebcd28ad458675e43e46270b6ecb6a8"
server_key_iv: "3469f62d87ee6b78f08b3ec7dbcbda55"
server_key_version: "encryptionkey@0"
I20260924 17:37:43.814095 28130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260924 17:37:43.814731 28145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:43.814944 28130 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260924 17:37:43.815042 28130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "bed71516b98a4f48aaa68a63f561e63e"
format_stamp: "Formatted at 2026-09-24 17:37:43 on dist-test-slave-gcz9"
server_key: "8ebcd28ad458675e43e46270b6ecb6a8"
server_key_iv: "3469f62d87ee6b78f08b3ec7dbcbda55"
server_key_version: "encryptionkey@0"
I20260924 17:37:43.815124 28130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:43.825078 28130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:43.826788 28130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:43.826977 28130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:43.830829 28130 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:35359
I20260924 17:37:43.830863 28197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:35359 every 8 connection(s)
I20260924 17:37:43.831255 28130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:43.831998 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28130
I20260924 17:37:43.832129 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:43.832253 28198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:43.832335 6292 external_mini_cluster.cc:1428] Setting key a496f8a0fe724d7469ce485a9cc69c82
I20260924 17:37:43.835619 28198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e: Bootstrap starting.
I20260924 17:37:43.836298 28198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:43.836614 28198 log.cc:824] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:43.837347 28198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e: No bootstrap required, opened a new log
Sep 24 17:37:43 dist-test-slave-gcz9 krb5kdc[28117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:43.839591 28198 raft_consensus.cc:348] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed71516b98a4f48aaa68a63f561e63e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35359 } }
I20260924 17:37:43.839731 28198 raft_consensus.cc:374] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:43.839754 28198 raft_consensus.cc:729] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed71516b98a4f48aaa68a63f561e63e, State: Initialized, Role: FOLLOWER
I20260924 17:37:43.839898 28198 consensus_queue.cc:260] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed71516b98a4f48aaa68a63f561e63e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35359 } }
I20260924 17:37:43.839977 28198 raft_consensus.cc:388] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:43.840013 28198 raft_consensus.cc:482] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:43.840081 28198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:43.840586 28198 raft_consensus.cc:504] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed71516b98a4f48aaa68a63f561e63e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35359 } }
I20260924 17:37:43.840703 28198 leader_election.cc:302] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bed71516b98a4f48aaa68a63f561e63e; no voters:
I20260924 17:37:43.840873 28198 leader_election.cc:288] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:43.840917 28203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:43.841063 28203 raft_consensus.cc:686] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [term 1 LEADER]: Becoming Leader. State: Replica: bed71516b98a4f48aaa68a63f561e63e, State: Running, Role: LEADER
I20260924 17:37:43.841140 28198 sys_catalog.cc:564] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:43.841208 28203 consensus_queue.cc:237] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed71516b98a4f48aaa68a63f561e63e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35359 } }
I20260924 17:37:43.841620 28203 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bed71516b98a4f48aaa68a63f561e63e. Latest consensus state: current_term: 1 leader_uuid: "bed71516b98a4f48aaa68a63f561e63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed71516b98a4f48aaa68a63f561e63e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35359 } } }
I20260924 17:37:43.841634 28205 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bed71516b98a4f48aaa68a63f561e63e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed71516b98a4f48aaa68a63f561e63e" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35359 } } }
I20260924 17:37:43.841779 28205 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:43.842015 28203 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:43.841998 28212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:43.842571 28212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:43.843756 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:43.832829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36593 (local address 127.6.37.62:35359)
0924 17:37:43.832994 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:43.833010 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:43.833034 (+ 24us) server_negotiation.cc:407] Connection header received
0924 17:37:43.833433 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:43.833439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:43.833483 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:43.833597 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:43.834376 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:43.835376 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:43.836464 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:43.836902 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:43.836988 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:43.839613 (+ 2625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:43.839617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:43.839617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:43.839628 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:43.841665 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:43.842163 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:43.842166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:43.842167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:43.842291 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:43.842567 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:43.842569 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:43.842569 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:43.842935 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:43.843089 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:43.843465 (+ 376us) server_negotiation.cc:299] Negotiation successful
0924 17:37:43.843563 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260924 17:37:43.844947 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:43.847366 28212 catalog_manager.cc:1347] Generated new cluster ID: c436fa137eb44a2cbfd7b1c5f28a14bc
I20260924 17:37:43.847419 28212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:43.853139 28201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:43.846221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49741 (local address 127.6.37.62:35359)
0924 17:37:43.846258 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:43.846260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:43.846376 (+ 116us) server_negotiation.cc:407] Connection header received
0924 17:37:43.846449 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:43.846450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:43.846460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:43.846507 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:43.847062 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:43.847759 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:43.848719 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:43.849036 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:43.849072 (+ 36us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:43.850464 (+ 1392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:43.850465 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:43.850465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:43.850471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:43.852015 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:43.852375 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:43.852376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:43.852376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:43.852422 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:43.852634 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:43.852635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:43.852635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:43.852739 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:43.852804 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:43.852999 (+ 195us) server_negotiation.cc:299] Negotiation successful
0924 17:37:43.853057 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:43.879693 28212 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:43.880765 28212 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:43.886744 28212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bed71516b98a4f48aaa68a63f561e63e: Generated new TSK 0
I20260924 17:37:43.886950 28212 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:43.896620 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28130
W20260924 17:37:43.901117 28115 connection.cc:535] client connection to 127.6.37.62:35359 recv error: Network error: failed to read from TLS socket (remote: 127.6.37.62:35359): Connection reset by peer (error 104)
2026-09-24T17:37:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1353 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:43 dist-test-slave-gcz9 krb5kdc[28229](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:43 dist-test-slave-gcz9 krb5kdc[28229](info): set up 2 sockets
Sep 24 17:37:43 dist-test-slave-gcz9 krb5kdc[28229](info): commencing operation
krb5kdc: starting...
W20260924 17:37:44.936762 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:45 dist-test-slave-gcz9 krb5kdc[28229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:45.049522 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33627
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:43375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:33627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:45.129801 28242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:45.130040 28242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:45.130077 28242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:45.131254 28242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:45.131323 28242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:45.131347 28242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:45.131369 28242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:45.131397 28242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:45.132858 28242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:43375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:33627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:33627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:45.133131 28242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:45.133349 28242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:45.138171 28248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:45.138200 28250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:45.138280 28242 server_base.cc:1034] running on GCE node
W20260924 17:37:45.138381 28247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:45.138607 28242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:45.138837 28242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:45.140021 28242 hybrid_clock.cc:648] HybridClock initialized: now 1790271465139990 us; error 40 us; skew 500 ppm
Sep 24 17:37:45 dist-test-slave-gcz9 krb5kdc[28229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271465, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:45.155658 28242 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:45.156176 28242 webserver.cc:460] Webserver started at http://127.6.37.62:38011/ using document root <none> and password file <none>
I20260924 17:37:45.156409 28242 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:45.156476 28242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:45.156639 28242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:45.157727 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "368a223f2e1e48718b9f3905a0672a3c"
format_stamp: "Formatted at 2026-09-24 17:37:45 on dist-test-slave-gcz9"
server_key: "3682123c4d60e4ff40b95cf80b0680a9"
server_key_iv: "a9801d1b9fa9ce5b82cd645efdacbaa5"
server_key_version: "encryptionkey@0"
I20260924 17:37:45.158103 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "368a223f2e1e48718b9f3905a0672a3c"
format_stamp: "Formatted at 2026-09-24 17:37:45 on dist-test-slave-gcz9"
server_key: "3682123c4d60e4ff40b95cf80b0680a9"
server_key_iv: "a9801d1b9fa9ce5b82cd645efdacbaa5"
server_key_version: "encryptionkey@0"
I20260924 17:37:45.159511 28242 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:37:45.160241 28257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:45.160409 28242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:45.160514 28242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "368a223f2e1e48718b9f3905a0672a3c"
format_stamp: "Formatted at 2026-09-24 17:37:45 on dist-test-slave-gcz9"
server_key: "3682123c4d60e4ff40b95cf80b0680a9"
server_key_iv: "a9801d1b9fa9ce5b82cd645efdacbaa5"
server_key_version: "encryptionkey@0"
I20260924 17:37:45.160593 28242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:45.172349 28242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:45.174340 28242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:45.174520 28242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:45.178519 28242 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:33627
I20260924 17:37:45.178552 28310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:33627 every 8 connection(s)
I20260924 17:37:45.178951 28242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:45.179809 28311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:45.181999 28311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c: Bootstrap starting.
I20260924 17:37:45.182536 28311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:45.182771 28311 log.cc:824] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:45.183472 28311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c: No bootstrap required, opened a new log
I20260924 17:37:45.183957 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28242
I20260924 17:37:45.184085 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:45.184264 6292 external_mini_cluster.cc:1428] Setting key 1ca83816674aced56a9376d2212caa83
I20260924 17:37:45.185688 28311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368a223f2e1e48718b9f3905a0672a3c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33627 } }
I20260924 17:37:45.185860 28311 raft_consensus.cc:374] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:45.185899 28311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 368a223f2e1e48718b9f3905a0672a3c, State: Initialized, Role: FOLLOWER
I20260924 17:37:45.186096 28311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368a223f2e1e48718b9f3905a0672a3c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33627 } }
I20260924 17:37:45.186200 28311 raft_consensus.cc:388] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:45.186231 28311 raft_consensus.cc:482] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:45.186278 28311 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:45.186971 28311 raft_consensus.cc:504] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368a223f2e1e48718b9f3905a0672a3c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33627 } }
I20260924 17:37:45.187075 28311 leader_election.cc:302] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 368a223f2e1e48718b9f3905a0672a3c; no voters:
I20260924 17:37:45.187227 28311 leader_election.cc:288] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:45.187295 28316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:45.187449 28311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:45.187489 28316 raft_consensus.cc:686] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [term 1 LEADER]: Becoming Leader. State: Replica: 368a223f2e1e48718b9f3905a0672a3c, State: Running, Role: LEADER
I20260924 17:37:45.187654 28316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368a223f2e1e48718b9f3905a0672a3c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33627 } }
I20260924 17:37:45.189134 28317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "368a223f2e1e48718b9f3905a0672a3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368a223f2e1e48718b9f3905a0672a3c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33627 } } }
W20260924 17:37:45.189340 28332 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260924 17:37:45.189357 28317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [sys.catalog]: This master's current role is: LEADER
W20260924 17:37:45.189477 28332 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:45.189658 28334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:45.189309 28318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 368a223f2e1e48718b9f3905a0672a3c. Latest consensus state: current_term: 1 leader_uuid: "368a223f2e1e48718b9f3905a0672a3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "368a223f2e1e48718b9f3905a0672a3c" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 33627 } } }
I20260924 17:37:45.189767 28318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:45.189888 28334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:45.191250 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:45.184787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54367 (local address 127.6.37.62:33627)
0924 17:37:45.184986 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:45.185005 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:45.185039 (+ 34us) server_negotiation.cc:407] Connection header received
0924 17:37:45.185645 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:45.185654 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:45.185720 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:45.185872 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:45.186276 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:45.187663 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:45.188782 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:45.189448 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:45.189574 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:45.190485 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:45.190489 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:45.190490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:45.190692 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:45.190729 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:45.190743 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:45.190834 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:45.190978 (+ 144us) server_negotiation.cc:299] Negotiation successful
0924 17:37:45.191009 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":78,"threads_started":1}
I20260924 17:37:45.191805 28334 catalog_manager.cc:1347] Generated new cluster ID: f75bccef716448629a63aa81d4e677d5
I20260924 17:37:45.191855 28334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:45.192209 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:45.197175 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:45.193646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37963 (local address 127.6.37.62:33627)
0924 17:37:45.193681 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:45.193683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:45.193801 (+ 118us) server_negotiation.cc:407] Connection header received
0924 17:37:45.193897 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:45.193898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:45.193907 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:45.193936 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:45.194125 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:45.194852 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:45.195859 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:45.196176 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:45.196249 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:45.196894 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:45.196895 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:45.196895 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:45.196899 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:45.196915 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:45.196921 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:45.196983 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:45.197085 (+ 102us) server_negotiation.cc:299] Negotiation successful
0924 17:37:45.197098 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:45.224413 28334 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:45.225032 28334 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:45.235777 28334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 368a223f2e1e48718b9f3905a0672a3c: Generated new TSK 0
I20260924 17:37:45.235983 28334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:45.248577 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28242
W20260924 17:37:45.253412 28227 connection.cc:535] client connection to 127.6.37.62:33627 recv error: Network error: failed to read from TLS socket (remote: 127.6.37.62:33627): Connection reset by peer (error 104)
2026-09-24T17:37:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:45 dist-test-slave-gcz9 krb5kdc[28343](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:45 dist-test-slave-gcz9 krb5kdc[28343](info): set up 2 sockets
Sep 24 17:37:45 dist-test-slave-gcz9 krb5kdc[28343](info): commencing operation
krb5kdc: starting...
W20260924 17:37:46.300938 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:46 dist-test-slave-gcz9 krb5kdc[28343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:46.417431 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42145
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:44671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:42145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:46.497457 28356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:46.497644 28356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:46.497666 28356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:46.498828 28356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:46.498884 28356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:46.498900 28356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:46.498914 28356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:46.498960 28356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:46.500398 28356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:44671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:42145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:42145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:46.500573 28356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:46.500734 28356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:46.505275 28362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:46.505265 28364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:46.505273 28361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:46.505594 28356 server_base.cc:1034] running on GCE node
I20260924 17:37:46.505820 28356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:46.506132 28356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:46.507268 28356 hybrid_clock.cc:648] HybridClock initialized: now 1790271466507202 us; error 79 us; skew 500 ppm
Sep 24 17:37:46 dist-test-slave-gcz9 krb5kdc[28343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271466, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:46.509651 28356 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:46.510057 28356 webserver.cc:460] Webserver started at http://127.6.37.62:35827/ using document root <none> and password file <none>
I20260924 17:37:46.510270 28356 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:46.510334 28356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:46.510483 28356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:46.511543 28356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "ca7891e06b8b42f8a9688ba0a378140a"
format_stamp: "Formatted at 2026-09-24 17:37:46 on dist-test-slave-gcz9"
server_key: "363bf917896d3da12269688e0f68c207"
server_key_iv: "ec118fd5428e931bac3d6c432ca1530a"
server_key_version: "encryptionkey@0"
I20260924 17:37:46.511942 28356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "ca7891e06b8b42f8a9688ba0a378140a"
format_stamp: "Formatted at 2026-09-24 17:37:46 on dist-test-slave-gcz9"
server_key: "363bf917896d3da12269688e0f68c207"
server_key_iv: "ec118fd5428e931bac3d6c432ca1530a"
server_key_version: "encryptionkey@0"
I20260924 17:37:46.513259 28356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:46.513983 28371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:46.514153 28356 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:46.514251 28356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "ca7891e06b8b42f8a9688ba0a378140a"
format_stamp: "Formatted at 2026-09-24 17:37:46 on dist-test-slave-gcz9"
server_key: "363bf917896d3da12269688e0f68c207"
server_key_iv: "ec118fd5428e931bac3d6c432ca1530a"
server_key_version: "encryptionkey@0"
I20260924 17:37:46.514331 28356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:46.517537 28356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:46.519387 28356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:46.519537 28356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:46.523475 28356 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:42145
I20260924 17:37:46.523506 28424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:42145 every 8 connection(s)
I20260924 17:37:46.523813 28356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:46.524706 28425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:46.526859 28425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a: Bootstrap starting.
I20260924 17:37:46.527499 28425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:46.527774 28425 log.cc:824] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:46.528411 28425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a: No bootstrap required, opened a new log
I20260924 17:37:46.530031 28425 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7891e06b8b42f8a9688ba0a378140a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42145 } }
I20260924 17:37:46.530159 28425 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:46.530205 28425 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca7891e06b8b42f8a9688ba0a378140a, State: Initialized, Role: FOLLOWER
I20260924 17:37:46.530367 28425 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7891e06b8b42f8a9688ba0a378140a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42145 } }
I20260924 17:37:46.530429 28425 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:46.530450 28425 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:46.530519 28425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:46.531415 28425 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7891e06b8b42f8a9688ba0a378140a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42145 } }
I20260924 17:37:46.531527 28425 leader_election.cc:302] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca7891e06b8b42f8a9688ba0a378140a; no voters:
I20260924 17:37:46.531702 28425 leader_election.cc:288] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:46.531739 28428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:46.531924 28428 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [term 1 LEADER]: Becoming Leader. State: Replica: ca7891e06b8b42f8a9688ba0a378140a, State: Running, Role: LEADER
I20260924 17:37:46.531946 28425 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:46.532030 28428 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7891e06b8b42f8a9688ba0a378140a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42145 } }
I20260924 17:37:46.532043 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28356
I20260924 17:37:46.532151 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:46.532335 6292 external_mini_cluster.cc:1428] Setting key 1c11d33da347178b084342a42542e82d
I20260924 17:37:46.532426 28428 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca7891e06b8b42f8a9688ba0a378140a. Latest consensus state: current_term: 1 leader_uuid: "ca7891e06b8b42f8a9688ba0a378140a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7891e06b8b42f8a9688ba0a378140a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42145 } } }
I20260924 17:37:46.532519 28428 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:46.532485 28429 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca7891e06b8b42f8a9688ba0a378140a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7891e06b8b42f8a9688ba0a378140a" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 42145 } } }
I20260924 17:37:46.532697 28429 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:46.532729 28437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:46.533281 28437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:46.535090 28437 catalog_manager.cc:1347] Generated new cluster ID: 67b9813bf4d64ddb9f2fb0a0bf213fcf
I20260924 17:37:46.535126 28441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:46.532926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53871 (local address 127.6.37.62:42145)
0924 17:37:46.533249 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:46.533257 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:46.533287 (+ 30us) server_negotiation.cc:407] Connection header received
0924 17:37:46.533396 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:46.533404 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:46.533433 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:46.533561 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:46.534591 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:46.534594 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:46.534594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:46.534599 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:46.534640 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:46.534655 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:46.534716 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:46.534847 (+ 131us) server_negotiation.cc:299] Negotiation successful
0924 17:37:46.534925 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":57,"threads_started":1}
I20260924 17:37:46.535138 28437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:46.539510 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:46.542076 28441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:46.541075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55179 (local address 127.6.37.62:42145)
0924 17:37:46.541107 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:46.541109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:46.541241 (+ 132us) server_negotiation.cc:407] Connection header received
0924 17:37:46.541291 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:46.541292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:46.541297 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:46.541350 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:46.541879 (+ 529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:46.541880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:46.541880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:46.541884 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:46.541898 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:46.541901 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:46.541951 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:46.541996 (+ 45us) server_negotiation.cc:299] Negotiation successful
0924 17:37:46.542007 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:46.544919 28437 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:46.545081 28437 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:46.548313 28437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca7891e06b8b42f8a9688ba0a378140a: Generated new TSK 0
I20260924 17:37:46.548480 28437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:46.550705 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28356
2026-09-24T17:37:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1301 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:46 dist-test-slave-gcz9 krb5kdc[28457](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:46 dist-test-slave-gcz9 krb5kdc[28457](info): set up 2 sockets
Sep 24 17:37:46 dist-test-slave-gcz9 krb5kdc[28457](info): commencing operation
krb5kdc: starting...
W20260924 17:37:47.616719 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.048s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:47 dist-test-slave-gcz9 krb5kdc[28457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:47.731851 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34533
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:41123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:34533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:47.810720 28470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:47.810983 28470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:47.811039 28470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:47.812180 28470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:47.812242 28470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:47.812266 28470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:47.812289 28470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:47.812316 28470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:47.813753 28470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:41123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:34533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:34533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:47.814029 28470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:47.814248 28470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:47.818970 28478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:47.818960 28475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:47.818957 28476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:47.819005 28470 server_base.cc:1034] running on GCE node
I20260924 17:37:47.819357 28470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:47.819590 28470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:47.820760 28470 hybrid_clock.cc:648] HybridClock initialized: now 1790271467820749 us; error 36 us; skew 500 ppm
Sep 24 17:37:47 dist-test-slave-gcz9 krb5kdc[28457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271467, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:47.823315 28470 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:47.823812 28470 webserver.cc:460] Webserver started at http://127.6.37.62:41913/ using document root <none> and password file <none>
I20260924 17:37:47.824003 28470 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:47.824043 28470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:47.824136 28470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:47.825063 28470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "463674de37824ca599c6977e6a137af5"
format_stamp: "Formatted at 2026-09-24 17:37:47 on dist-test-slave-gcz9"
server_key: "176dfbd4754ff11c8761276d7e2ce7f1"
server_key_iv: "936fea98ff36ecfbbb927a34a0394654"
server_key_version: "encryptionkey@0"
I20260924 17:37:47.825346 28470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "463674de37824ca599c6977e6a137af5"
format_stamp: "Formatted at 2026-09-24 17:37:47 on dist-test-slave-gcz9"
server_key: "176dfbd4754ff11c8761276d7e2ce7f1"
server_key_iv: "936fea98ff36ecfbbb927a34a0394654"
server_key_version: "encryptionkey@0"
I20260924 17:37:47.826609 28470 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:47.827322 28485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:47.827519 28470 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:47.827602 28470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "463674de37824ca599c6977e6a137af5"
format_stamp: "Formatted at 2026-09-24 17:37:47 on dist-test-slave-gcz9"
server_key: "176dfbd4754ff11c8761276d7e2ce7f1"
server_key_iv: "936fea98ff36ecfbbb927a34a0394654"
server_key_version: "encryptionkey@0"
I20260924 17:37:47.827656 28470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:47.861428 28470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:47.863838 28470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:47.863950 28470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:47.867800 28470 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:34533
I20260924 17:37:47.867877 28539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:34533 every 8 connection(s)
I20260924 17:37:47.868213 28470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:47.869040 28540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:47.871354 28540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5: Bootstrap starting.
I20260924 17:37:47.871927 28540 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:47.872220 28540 log.cc:824] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:47.872892 28540 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5: No bootstrap required, opened a new log
I20260924 17:37:47.874431 28540 raft_consensus.cc:348] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "463674de37824ca599c6977e6a137af5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34533 } }
I20260924 17:37:47.874601 28540 raft_consensus.cc:374] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:47.874648 28540 raft_consensus.cc:729] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 463674de37824ca599c6977e6a137af5, State: Initialized, Role: FOLLOWER
I20260924 17:37:47.874811 28540 consensus_queue.cc:260] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "463674de37824ca599c6977e6a137af5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34533 } }
I20260924 17:37:47.874924 28540 raft_consensus.cc:388] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:47.874969 28540 raft_consensus.cc:482] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:47.875017 28540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:47.875808 28540 raft_consensus.cc:504] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "463674de37824ca599c6977e6a137af5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34533 } }
I20260924 17:37:47.875926 28540 leader_election.cc:302] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 463674de37824ca599c6977e6a137af5; no voters:
I20260924 17:37:47.876103 28540 leader_election.cc:288] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:47.876132 28543 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:47.876298 28543 raft_consensus.cc:686] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [term 1 LEADER]: Becoming Leader. State: Replica: 463674de37824ca599c6977e6a137af5, State: Running, Role: LEADER
I20260924 17:37:47.876426 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28470
I20260924 17:37:47.876441 28543 consensus_queue.cc:237] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "463674de37824ca599c6977e6a137af5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34533 } }
I20260924 17:37:47.876542 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:47.876724 6292 external_mini_cluster.cc:1428] Setting key 3d47d1fe5f65db36ad4b0d475406cddb
I20260924 17:37:47.876842 28545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 463674de37824ca599c6977e6a137af5. Latest consensus state: current_term: 1 leader_uuid: "463674de37824ca599c6977e6a137af5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "463674de37824ca599c6977e6a137af5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34533 } } }
I20260924 17:37:47.877008 28540 sys_catalog.cc:564] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:47.876838 28544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "463674de37824ca599c6977e6a137af5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "463674de37824ca599c6977e6a137af5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 34533 } } }
I20260924 17:37:47.877194 28544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:47.877027 28545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:47.877556 28548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:47.878158 28548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:47.879750 28548 catalog_manager.cc:1347] Generated new cluster ID: d2b9ef9b893f47779610049dfbcf46bf
I20260924 17:37:47.879799 28548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 24 17:37:47 dist-test-slave-gcz9 krb5kdc[28457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271467, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:47.887673 28548 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:47.888262 28548 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:47.888506 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:47.877336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33891 (local address 127.6.37.62:34533)
0924 17:37:47.877604 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:47.877615 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:47.877648 (+ 33us) server_negotiation.cc:407] Connection header received
0924 17:37:47.877777 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:47.877785 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:47.877847 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:47.878003 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:47.878782 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:47.880198 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:47.881251 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:47.881860 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:47.881980 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:47.884708 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:47.884712 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:47.884712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:47.884723 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:47.886654 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:47.887095 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:47.887098 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:47.887098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:47.887203 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:47.887439 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:47.887441 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:47.887441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:47.887727 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:47.887881 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:47.888143 (+ 262us) server_negotiation.cc:299] Negotiation successful
0924 17:37:47.888292 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":78,"threads_started":1}
I20260924 17:37:47.889472 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:47.894124 28548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 463674de37824ca599c6977e6a137af5: Generated new TSK 0
I20260924 17:37:47.894296 28548 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:47.900187 28549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:47.890954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56433 (local address 127.6.37.62:34533)
0924 17:37:47.890988 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:47.890990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:47.893872 (+ 2882us) server_negotiation.cc:407] Connection header received
0924 17:37:47.893926 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:47.893927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:47.893937 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:47.893985 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:47.894651 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:47.895461 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:47.896133 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:47.896462 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:47.896531 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:47.897614 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:47.897615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:47.897615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:47.897622 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:47.899138 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:47.899440 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:47.899441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:47.899442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:47.899497 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:47.899673 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:47.899674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:47.899674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:47.899797 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:47.899889 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:47.899969 (+ 80us) server_negotiation.cc:299] Negotiation successful
0924 17:37:47.900071 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:47.902060 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28470
2026-09-24T17:37:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1351 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:47 dist-test-slave-gcz9 krb5kdc[28571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:47 dist-test-slave-gcz9 krb5kdc[28571](info): set up 2 sockets
Sep 24 17:37:47 dist-test-slave-gcz9 krb5kdc[28571](info): commencing operation
krb5kdc: starting...
W20260924 17:37:48.996805 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:49 dist-test-slave-gcz9 krb5kdc[28571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271469, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:49.110071 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46183
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:40365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:46183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:49.190464 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:49.190685 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:49.190723 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:49.191895 28584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:49.191962 28584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:49.191996 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:49.192029 28584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:49.192051 28584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:49.193480 28584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:40365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:46183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:46183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:49.193763 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:49.193985 28584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:49.198698 28590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:49.198788 28584 server_base.cc:1034] running on GCE node
W20260924 17:37:49.198710 28589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:49.198704 28592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:49.199237 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:49.199527 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:49.200667 28584 hybrid_clock.cc:648] HybridClock initialized: now 1790271469200656 us; error 31 us; skew 500 ppm
Sep 24 17:37:49 dist-test-slave-gcz9 krb5kdc[28571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271469, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:49.203123 28584 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:49.203541 28584 webserver.cc:460] Webserver started at http://127.6.37.62:46415/ using document root <none> and password file <none>
I20260924 17:37:49.203754 28584 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:49.203799 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:49.203933 28584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:49.204981 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "45f062e15f6a42999dc0af7b9fb52cea"
format_stamp: "Formatted at 2026-09-24 17:37:49 on dist-test-slave-gcz9"
server_key: "d75f8de3f0b7cd2e7d96b56d20bbf8b8"
server_key_iv: "44b25db20652fbce1d03a54c2ba2d203"
server_key_version: "encryptionkey@0"
I20260924 17:37:49.205334 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "45f062e15f6a42999dc0af7b9fb52cea"
format_stamp: "Formatted at 2026-09-24 17:37:49 on dist-test-slave-gcz9"
server_key: "d75f8de3f0b7cd2e7d96b56d20bbf8b8"
server_key_iv: "44b25db20652fbce1d03a54c2ba2d203"
server_key_version: "encryptionkey@0"
I20260924 17:37:49.206612 28584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:37:49.207355 28599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:49.207541 28584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:49.207629 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "45f062e15f6a42999dc0af7b9fb52cea"
format_stamp: "Formatted at 2026-09-24 17:37:49 on dist-test-slave-gcz9"
server_key: "d75f8de3f0b7cd2e7d96b56d20bbf8b8"
server_key_iv: "44b25db20652fbce1d03a54c2ba2d203"
server_key_version: "encryptionkey@0"
I20260924 17:37:49.207700 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:49.221704 28584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:49.223948 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:49.224102 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:49.228214 28584 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:46183
I20260924 17:37:49.228264 28652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:46183 every 8 connection(s)
I20260924 17:37:49.228578 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:49.229379 28653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:49.231678 28653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea: Bootstrap starting.
I20260924 17:37:49.232237 28653 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:49.232523 28653 log.cc:824] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:49.233188 28653 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea: No bootstrap required, opened a new log
I20260924 17:37:49.234099 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28584
I20260924 17:37:49.234186 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:49.234371 6292 external_mini_cluster.cc:1428] Setting key fd75a7c9da9de70457bc9f470a91d292
I20260924 17:37:49.235188 28653 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f062e15f6a42999dc0af7b9fb52cea" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46183 } }
I20260924 17:37:49.235345 28653 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:49.235414 28653 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f062e15f6a42999dc0af7b9fb52cea, State: Initialized, Role: FOLLOWER
I20260924 17:37:49.235565 28653 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f062e15f6a42999dc0af7b9fb52cea" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46183 } }
I20260924 17:37:49.235663 28653 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:49.235741 28653 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:49.235793 28653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:49.236333 28653 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f062e15f6a42999dc0af7b9fb52cea" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46183 } }
I20260924 17:37:49.236418 28653 leader_election.cc:302] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45f062e15f6a42999dc0af7b9fb52cea; no voters:
I20260924 17:37:49.236627 28653 leader_election.cc:288] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:49.236657 28658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:49.236760 28658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [term 1 LEADER]: Becoming Leader. State: Replica: 45f062e15f6a42999dc0af7b9fb52cea, State: Running, Role: LEADER
I20260924 17:37:49.236891 28653 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:49.236902 28658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f062e15f6a42999dc0af7b9fb52cea" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46183 } }
I20260924 17:37:49.237346 28658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45f062e15f6a42999dc0af7b9fb52cea. Latest consensus state: current_term: 1 leader_uuid: "45f062e15f6a42999dc0af7b9fb52cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f062e15f6a42999dc0af7b9fb52cea" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46183 } } }
I20260924 17:37:49.237493 28658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:49.237752 28668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:49.238286 28668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:49.238500 28659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45f062e15f6a42999dc0af7b9fb52cea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f062e15f6a42999dc0af7b9fb52cea" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 46183 } } }
I20260924 17:37:49.238636 28659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:49.239964 28668 catalog_manager.cc:1347] Generated new cluster ID: 4b1d10a585ec4026bd3f80929d318933
I20260924 17:37:49.240190 28668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:49.240609 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:49.234855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50705 (local address 127.6.37.62:46183)
0924 17:37:49.235077 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:49.235085 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:49.235109 (+ 24us) server_negotiation.cc:407] Connection header received
0924 17:37:49.235203 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:49.235208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:49.235249 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:49.235399 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:49.235640 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:49.237152 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:49.238307 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:49.238947 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:49.239055 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:49.239739 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:49.239743 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:49.239743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:49.239968 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:49.240005 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:49.240018 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:49.240081 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:49.240345 (+ 264us) server_negotiation.cc:299] Negotiation successful
0924 17:37:49.240407 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":113,"threads_started":1}
I20260924 17:37:49.241524 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:49.244180 28668 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:49.244650 28668 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:49.246400 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:49.243013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48421 (local address 127.6.37.62:46183)
0924 17:37:49.243045 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:49.243047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:49.243055 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:49.243097 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:49.243098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:49.243107 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:49.243169 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:49.243294 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:49.243978 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:49.245081 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:49.245360 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:49.245402 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:49.246127 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:49.246128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:49.246129 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:49.246133 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:49.246146 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:49.246150 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:49.246178 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:49.246286 (+ 108us) server_negotiation.cc:299] Negotiation successful
0924 17:37:49.246330 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260924 17:37:49.246459 28668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45f062e15f6a42999dc0af7b9fb52cea: Generated new TSK 0
I20260924 17:37:49.246609 28668 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:49.248370 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28584
2026-09-24T17:37:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1346 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:49 dist-test-slave-gcz9 krb5kdc[28685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:49 dist-test-slave-gcz9 krb5kdc[28685](info): set up 2 sockets
Sep 24 17:37:49 dist-test-slave-gcz9 krb5kdc[28685](info): commencing operation
krb5kdc: starting...
W20260924 17:37:50.284694 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:50 dist-test-slave-gcz9 krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:50.402033 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40141
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:40141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:50.487699 28698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:50.487918 28698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:50.487957 28698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:50.489077 28698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:50.489140 28698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:50.489166 28698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:50.489197 28698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:50.489219 28698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:50.490707 28698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:40141
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:40141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:50.490999 28698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:50.491216 28698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:50.495782 28706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:50.495836 28704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:50.495779 28703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:50.496011 28698 server_base.cc:1034] running on GCE node
I20260924 17:37:50.496232 28698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:50.496502 28698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:50.497644 28698 hybrid_clock.cc:648] HybridClock initialized: now 1790271470497635 us; error 30 us; skew 500 ppm
Sep 24 17:37:50 dist-test-slave-gcz9 krb5kdc[28685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271470, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:50.503490 28698 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:50.503974 28698 webserver.cc:460] Webserver started at http://127.6.37.62:42445/ using document root <none> and password file <none>
I20260924 17:37:50.504216 28698 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:50.504285 28698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:50.504449 28698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:50.505471 28698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "8014cbe2d6834f758bc6e6fb5392d9a5"
format_stamp: "Formatted at 2026-09-24 17:37:50 on dist-test-slave-gcz9"
server_key: "43404ce334964c8ee29b02d6a12e5267"
server_key_iv: "a00a1a387c9074a6047286be0ace05ba"
server_key_version: "encryptionkey@0"
I20260924 17:37:50.505825 28698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "8014cbe2d6834f758bc6e6fb5392d9a5"
format_stamp: "Formatted at 2026-09-24 17:37:50 on dist-test-slave-gcz9"
server_key: "43404ce334964c8ee29b02d6a12e5267"
server_key_iv: "a00a1a387c9074a6047286be0ace05ba"
server_key_version: "encryptionkey@0"
I20260924 17:37:50.507128 28698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:50.507826 28713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:50.508025 28698 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:50.508116 28698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "8014cbe2d6834f758bc6e6fb5392d9a5"
format_stamp: "Formatted at 2026-09-24 17:37:50 on dist-test-slave-gcz9"
server_key: "43404ce334964c8ee29b02d6a12e5267"
server_key_iv: "a00a1a387c9074a6047286be0ace05ba"
server_key_version: "encryptionkey@0"
I20260924 17:37:50.508170 28698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:50.511345 28698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:50.513118 28698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:50.513218 28698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:50.517140 28698 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:40141
I20260924 17:37:50.517169 28766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:40141 every 8 connection(s)
I20260924 17:37:50.517500 28698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:50.518503 28767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:50.520726 28767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5: Bootstrap starting.
I20260924 17:37:50.521281 28767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:50.521559 28767 log.cc:824] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:50.522220 28767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5: No bootstrap required, opened a new log
I20260924 17:37:50.523851 28767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40141 } }
I20260924 17:37:50.523983 28767 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260924 17:37:50.524006 28767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8014cbe2d6834f758bc6e6fb5392d9a5, State: Initialized, Role: FOLLOWER
I20260924 17:37:50.524181 28767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40141 } }
I20260924 17:37:50.524246 28767 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260924 17:37:50.524283 28767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260924 17:37:50.524334 28767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:50.525125 28767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40141 } }
I20260924 17:37:50.525235 28767 leader_election.cc:302] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8014cbe2d6834f758bc6e6fb5392d9a5; no voters:
I20260924 17:37:50.525404 28767 leader_election.cc:288] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260924 17:37:50.525439 28770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:50.525640 28770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8014cbe2d6834f758bc6e6fb5392d9a5, State: Running, Role: LEADER
I20260924 17:37:50.525664 28767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:50.525728 28770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40141 } }
I20260924 17:37:50.526139 28771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40141 } } }
I20260924 17:37:50.526293 28771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:50.526372 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28698
I20260924 17:37:50.526494 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:50.526697 6292 external_mini_cluster.cc:1428] Setting key 696a66c91ebc66a4c8b128fc8b04784d
I20260924 17:37:50.526896 28780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:50.527469 28780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:50.526141 28772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8014cbe2d6834f758bc6e6fb5392d9a5. Latest consensus state: current_term: 1 leader_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8014cbe2d6834f758bc6e6fb5392d9a5" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 40141 } } }
I20260924 17:37:50.527523 28772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:50.529322 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:50.527422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50185 (local address 127.6.37.62:40141)
0924 17:37:50.527688 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:50.527696 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:50.527719 (+ 23us) server_negotiation.cc:407] Connection header received
0924 17:37:50.528061 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:50.528070 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:50.528102 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:50.528235 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:50.528847 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:50.528851 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:50.528852 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:50.528856 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:50.528899 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:50.528915 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:50.528979 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:50.529101 (+ 122us) server_negotiation.cc:299] Negotiation successful
0924 17:37:50.529142 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":81,"threads_started":1}
I20260924 17:37:50.529337 28780 catalog_manager.cc:1347] Generated new cluster ID: f40f2d3f7cd94c85aa4a01e783bf918a
I20260924 17:37:50.529404 28780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:50.530121 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:50.532552 28790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:50.531438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57757 (local address 127.6.37.62:40141)
0924 17:37:50.531478 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:50.531480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:50.531623 (+ 143us) server_negotiation.cc:407] Connection header received
0924 17:37:50.531699 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:50.531700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:50.531705 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:50.531759 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:50.532328 (+ 569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:50.532330 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:50.532330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0924 17:37:50.532334 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:50.532347 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0924 17:37:50.532351 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:50.532407 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:50.532465 (+ 58us) server_negotiation.cc:299] Negotiation successful
0924 17:37:50.532479 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:50.541818 28780 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:50.542011 28780 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:50.545135 28780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8014cbe2d6834f758bc6e6fb5392d9a5: Generated new TSK 0
I20260924 17:37:50.545303 28780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:50.547835 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28698
2026-09-24T17:37:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1299 ms)
[----------] 18 tests from AuthTokenIssuingTest (24062 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:50 dist-test-slave-gcz9 krb5kdc[28799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:50 dist-test-slave-gcz9 krb5kdc[28799](info): set up 2 sockets
Sep 24 17:37:50 dist-test-slave-gcz9 krb5kdc[28799](info): commencing operation
krb5kdc: starting...
W20260924 17:37:51.584838 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:51 dist-test-slave-gcz9 krb5kdc[28799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:51.706243 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:35083
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:35083,127.6.37.61:34837,127.6.37.60:45381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:51.785023 28812 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 17:37:51.785228 28812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:51.785245 28812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:51.785266 28812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:51.786438 28812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:51.786477 28812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:51.786492 28812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:51.786548 28812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:51.786578 28812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:51.788146 28812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:35083,127.6.37.61:34837,127.6.37.60:45381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:35083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:51.788401 28812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:51.788632 28812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:51.793579 28818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:51.793609 28820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:51.793625 28817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:51.793675 28812 server_base.cc:1034] running on GCE node
I20260924 17:37:51.793992 28812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:51.794274 28812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:51.795414 28812 hybrid_clock.cc:648] HybridClock initialized: now 1790271471795401 us; error 28 us; skew 500 ppm
Sep 24 17:37:51 dist-test-slave-gcz9 krb5kdc[28799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:51.797803 28812 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:51.798257 28812 webserver.cc:460] Webserver started at http://127.6.37.62:34183/ using document root <none> and password file <none>
I20260924 17:37:51.798502 28812 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:51.798547 28812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:51.798691 28812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:51.799834 28812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "20533fea886241dda5579322bb7896ac"
format_stamp: "Formatted at 2026-09-24 17:37:51 on dist-test-slave-gcz9"
server_key: "7f2d952594684a3d1fa3bbaf07be153e"
server_key_iv: "19a92cf168b4e53873f822c214d1bf04"
server_key_version: "encryptionkey@0"
I20260924 17:37:51.800185 28812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "20533fea886241dda5579322bb7896ac"
format_stamp: "Formatted at 2026-09-24 17:37:51 on dist-test-slave-gcz9"
server_key: "7f2d952594684a3d1fa3bbaf07be153e"
server_key_iv: "19a92cf168b4e53873f822c214d1bf04"
server_key_version: "encryptionkey@0"
I20260924 17:37:51.801406 28812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:51.802058 28827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:51.802248 28812 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:51.802341 28812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "20533fea886241dda5579322bb7896ac"
format_stamp: "Formatted at 2026-09-24 17:37:51 on dist-test-slave-gcz9"
server_key: "7f2d952594684a3d1fa3bbaf07be153e"
server_key_iv: "19a92cf168b4e53873f822c214d1bf04"
server_key_version: "encryptionkey@0"
I20260924 17:37:51.802416 28812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:51.824885 28812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:51.826730 28812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:51.826911 28812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:51.831024 28812 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:35083
I20260924 17:37:51.831079 28879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:35083 every 8 connection(s)
I20260924 17:37:51.831398 28812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:51.832360 28880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:51.834059 28880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:37:51 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:51.840646 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28812
I20260924 17:37:51.840757 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
I20260924 17:37:51.840986 6292 external_mini_cluster.cc:1428] Setting key 5507bf0fbe426017358991852d943f14
I20260924 17:37:51.843326 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.834710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:35083 (local address 127.0.0.1:48746)
0924 17:37:51.834865 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.834933 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:51.835384 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:51.835649 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:51.835651 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:51.835894 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:51.836050 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:51.836053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.837011 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.837012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:51.837678 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:51.837680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.838164 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.838165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:51.838218 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:51.838628 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:51.838637 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:51.839984 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:51.841746 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:51.841753 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:51.841755 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:51.842013 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:51.842240 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:51.842241 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:51.842241 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:51.842330 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:51.842678 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:51.842683 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:51.842745 (+ 62us) client_negotiation.cc:769] Sending connection context
0924 17:37:51.842872 (+ 127us) client_negotiation.cc:240] Negotiation successful
0924 17:37:51.843150 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":123,"thread_start_us":81,"threads_started":1}
I20260924 17:37:51.843330 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.834771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.6.37.62:35083)
0924 17:37:51.834940 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:51.834944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:51.835011 (+ 67us) server_negotiation.cc:407] Connection header received
0924 17:37:51.835519 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:51.835521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:51.835538 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:51.835621 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:51.836134 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.836922 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.837751 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.838076 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.838162 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:51.840058 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:51.840065 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:51.840066 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:51.840072 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:51.841664 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:51.842091 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:51.842093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:51.842093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:51.842167 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:51.842397 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:51.842398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:51.842398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:51.842597 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:51.842687 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:51.842912 (+ 225us) server_negotiation.cc:299] Negotiation successful
0924 17:37:51.843102 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260924 17:37:51.844281 28880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:51.844615 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.844514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44818)
0924 17:37:51.844555 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.844594 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260924 17:37:51.844784 28831 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
I20260924 17:37:51.845216 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.845132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44820)
0924 17:37:51.845176 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.845199 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:37:51.845320 28880 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:34837: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.6.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab.
Entry for principal kudu/127.6.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab.
I20260924 17:37:51.865022 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:34837
--webserver_interface=127.6.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab
--principal=kudu/127.6.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:35083,127.6.37.61:34837,127.6.37.60:45381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:51.894629 28880 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } attempt: 1
I20260924 17:37:51.895174 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.895032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44828)
0924 17:37:51.895109 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.895144 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260924 17:37:51.895561 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.895440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44840)
0924 17:37:51.895506 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.895538 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260924 17:37:51.895655 28880 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:34837: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
W20260924 17:37:51.944725 28887 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 17:37:51.944957 28887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:51.944988 28887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:51.945056 28887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:51.946159 28887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:51.946223 28887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:51.946245 28887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:51.946266 28887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:51.946295 28887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:51.947773 28887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:35083,127.6.37.61:34837,127.6.37.60:45381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab
--principal=kudu/127.6.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:34837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:51.948052 28887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:51.948271 28887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:51.953085 28893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:51.953063 28892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:51.953300 28887 server_base.cc:1034] running on GCE node
W20260924 17:37:51.953081 28895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:51.953629 28887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:51.953920 28887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:51.955088 28887 hybrid_clock.cc:648] HybridClock initialized: now 1790271471955073 us; error 27 us; skew 500 ppm
Sep 24 17:37:51 dist-test-slave-gcz9 krb5kdc[28799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:51.957423 28887 init.cc:377] Logged in from keytab as kudu/127.6.37.61@KRBTEST.COM (short username kudu)
I20260924 17:37:51.957844 28887 webserver.cc:460] Webserver started at http://127.6.37.61:38429/ using document root <none> and password file <none>
I20260924 17:37:51.958066 28887 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:51.958137 28887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:51.958288 28887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:51.959442 28887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data/instance:
uuid: "2e10165f286a43f09cef1ffd7eb521f9"
format_stamp: "Formatted at 2026-09-24 17:37:51 on dist-test-slave-gcz9"
server_key: "4b6a691aa6e3555b933170b59a076ebf"
server_key_iv: "265a7dab20fc9b6e8cf43496a26e22e1"
server_key_version: "encryptionkey@0"
I20260924 17:37:51.959811 28887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal/instance:
uuid: "2e10165f286a43f09cef1ffd7eb521f9"
format_stamp: "Formatted at 2026-09-24 17:37:51 on dist-test-slave-gcz9"
server_key: "4b6a691aa6e3555b933170b59a076ebf"
server_key_iv: "265a7dab20fc9b6e8cf43496a26e22e1"
server_key_version: "encryptionkey@0"
I20260924 17:37:51.961112 28887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:51.961796 28902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:51.961982 28887 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:51.962086 28887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal
uuid: "2e10165f286a43f09cef1ffd7eb521f9"
format_stamp: "Formatted at 2026-09-24 17:37:51 on dist-test-slave-gcz9"
server_key: "4b6a691aa6e3555b933170b59a076ebf"
server_key_iv: "265a7dab20fc9b6e8cf43496a26e22e1"
server_key_version: "encryptionkey@0"
I20260924 17:37:51.962162 28887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:51.963835 28880 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } attempt: 2
I20260924 17:37:51.964274 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.964118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44852)
0924 17:37:51.964205 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.964244 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260924 17:37:51.964733 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.964628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44866)
0924 17:37:51.964675 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.964712 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260924 17:37:51.964854 28880 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:34837: Network error: Client connection negotiation failed: client connection to 127.6.37.61:34837: connect: Connection refused (error 111)
I20260924 17:37:51.979890 28887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:51.981809 28887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:51.981930 28887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:51.986217 28887 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.61:34837
I20260924 17:37:51.986248 28954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.61:34837 every 8 connection(s)
I20260924 17:37:51.986614 28887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
I20260924 17:37:51.987648 28955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:51.989240 28955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:51.989784 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28887
I20260924 17:37:51.989892 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-1/wal/instance
I20260924 17:37:51.990126 6292 external_mini_cluster.cc:1428] Setting key 614043308cc97f71b91b5a9fb02d4495
Sep 24 17:37:51 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.6.37.60@KRBTEST.COM; defaulting to no policy
I20260924 17:37:51.998847 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.990061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.6.37.62:35083)
0924 17:37:51.990120 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:51.990122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:51.990398 (+ 276us) server_negotiation.cc:407] Connection header received
0924 17:37:51.990843 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:51.990845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:51.990860 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:51.990961 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:51.991626 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.992129 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.993247 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.993626 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.993709 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:51.995806 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:51.995808 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:51.995809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:51.995819 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:51.997489 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:51.997872 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:51.997873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:51.997874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:51.997942 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:51.998179 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:51.998180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:51.998181 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:51.998333 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:51.998418 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:51.998683 (+ 265us) server_negotiation.cc:299] Negotiation successful
0924 17:37:51.998775 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260924 17:37:51.999048 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.990059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:35083 (local address 127.0.0.1:48756)
0924 17:37:51.990252 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.990302 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:51.990745 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:51.991019 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:51.991022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:51.991250 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:51.991515 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:51.991523 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.992223 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.992224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:51.993151 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:51.993154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:51.993748 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:51.993750 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:51.993855 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:51.994333 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:51.994341 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:51.995699 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:51.997574 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:51.997581 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:51.997582 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:51.997788 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:51.998021 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:51.998022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:51.998022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:51.998112 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:51.998424 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:51.998436 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:51.998550 (+ 114us) client_negotiation.cc:769] Sending connection context
0924 17:37:51.998634 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:37:51.998747 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":89,"threads_started":1}
I20260924 17:37:51.999676 28955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.60@KRBTEST.COM" created.
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:37:52.007282 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.000018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44878 (local address 127.6.37.61:34837)
0924 17:37:52.000176 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.000179 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.000195 (+ 16us) server_negotiation.cc:407] Connection header received
0924 17:37:52.000210 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.000212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.000221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.000304 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.000553 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.001224 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.001884 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.002192 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.002280 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.004336 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.004344 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.004344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.004350 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.006095 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.006480 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.006483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.006483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.006540 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.006741 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.006742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.006742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.006862 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.006975 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.007131 (+ 156us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.007212 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260924 17:37:52.007411 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:51.999930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44878)
0924 17:37:51.999977 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:51.999988 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.000035 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.000302 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.000303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.000437 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.000477 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.000479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.001287 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.001289 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.001791 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.001793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.002279 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.002280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.002345 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.002747 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.002751 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.004254 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.006176 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.006177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.006178 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.006400 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.006609 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.006610 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.006611 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.006678 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.006963 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.006972 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.007023 (+ 51us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.007109 (+ 86us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.007274 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":60}
I20260924 17:37:52.008034 28955 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:52.008383 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.008238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47156)
0924 17:37:52.008294 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.008350 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260924 17:37:52.008526 28904 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
I20260924 17:37:52.008961 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.008833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47160)
0924 17:37:52.008895 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.008929 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260924 17:37:52.009109 28955 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:45381: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab.
Entry for principal kudu/127.6.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab.
I20260924 17:37:52.017704 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:45381
--webserver_interface=127.6.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab
--principal=kudu/127.6.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:33677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:35083,127.6.37.61:34837,127.6.37.60:45381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:52.056020 28880 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } attempt: 3
I20260924 17:37:52.058328 28955 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } attempt: 1
I20260924 17:37:52.058744 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.058607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47174)
0924 17:37:52.058668 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.058706 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260924 17:37:52.059177 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.059052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47190)
0924 17:37:52.059123 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.059151 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260924 17:37:52.059322 28955 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:45381: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:37:52.063354 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.056458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44890 (local address 127.6.37.61:34837)
0924 17:37:52.056525 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.056527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.056539 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:37:52.056593 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.056594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.056604 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.056656 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.056993 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.057491 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.058224 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.058502 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.058575 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.060860 (+ 2285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.060861 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.060862 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.060870 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.062287 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.062662 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.062663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.062663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.062713 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.062923 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.062924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.062924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.063034 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.063086 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.063240 (+ 154us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.063301 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260924 17:37:52.063416 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.056388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44890)
0924 17:37:52.056449 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.056460 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.056530 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.056660 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.056661 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.056832 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.056896 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.056898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.057581 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.057582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.058130 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.058132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.058648 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.058650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.058736 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.059210 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.059216 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.060743 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.062372 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.062373 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.062374 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.062590 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.062783 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.062784 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.062784 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.062849 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.063097 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.063098 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.063149 (+ 51us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.063225 (+ 76us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.063323 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260924 17:37:52.063879 28880 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:52.064211 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.064108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47194)
0924 17:37:52.064155 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.064187 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260924 17:37:52.064538 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.064444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47204)
0924 17:37:52.064495 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.064519 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260924 17:37:52.064653 28880 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:45381: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
I20260924 17:37:52.095927 28880 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } attempt: 1
I20260924 17:37:52.096442 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.096305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47210)
0924 17:37:52.096372 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.096415 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260924 17:37:52.096830 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.096748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47212)
0924 17:37:52.096790 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.096814 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:37:52.096932 28880 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:45381: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
W20260924 17:37:52.100135 28962 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 17:37:52.100314 28962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:52.100356 28962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:52.100395 28962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:52.101500 28962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:52.101537 28962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:52.101552 28962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:52.101588 28962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:52.101613 28962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:52.103158 28962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:33677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:35083,127.6.37.61:34837,127.6.37.60:45381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab
--principal=kudu/127.6.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:45381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.6.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:52.103398 28962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:52.103623 28962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:52.108376 28970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:52.108393 28967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:52.108395 28968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:52.108575 28962 server_base.cc:1034] running on GCE node
I20260924 17:37:52.108999 28962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:52.109301 28962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:52.110500 28962 hybrid_clock.cc:648] HybridClock initialized: now 1790271472110475 us; error 40 us; skew 500 ppm
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271472, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:52.113234 28962 init.cc:377] Logged in from keytab as kudu/127.6.37.60@KRBTEST.COM (short username kudu)
I20260924 17:37:52.113711 28962 webserver.cc:460] Webserver started at http://127.6.37.60:44251/ using document root <none> and password file <none>
I20260924 17:37:52.113929 28962 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:52.113973 28962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:52.114066 28962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:52.115231 28962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data/instance:
uuid: "920152bf0e1d469891c8cc567524f1a8"
format_stamp: "Formatted at 2026-09-24 17:37:52 on dist-test-slave-gcz9"
server_key: "175dc5c0854a08a1a423209fd9f85033"
server_key_iv: "05e1423fa0e8b87402fc38e364e46099"
server_key_version: "encryptionkey@0"
I20260924 17:37:52.115550 28962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal/instance:
uuid: "920152bf0e1d469891c8cc567524f1a8"
format_stamp: "Formatted at 2026-09-24 17:37:52 on dist-test-slave-gcz9"
server_key: "175dc5c0854a08a1a423209fd9f85033"
server_key_iv: "05e1423fa0e8b87402fc38e364e46099"
server_key_version: "encryptionkey@0"
I20260924 17:37:52.116950 28962 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260924 17:37:52.117642 28977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:52.117844 28962 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:52.117957 28962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal
uuid: "920152bf0e1d469891c8cc567524f1a8"
format_stamp: "Formatted at 2026-09-24 17:37:52 on dist-test-slave-gcz9"
server_key: "175dc5c0854a08a1a423209fd9f85033"
server_key_iv: "05e1423fa0e8b87402fc38e364e46099"
server_key_version: "encryptionkey@0"
I20260924 17:37:52.118039 28962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:52.127483 28955 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } attempt: 2
I20260924 17:37:52.127910 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.127782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47226)
0924 17:37:52.127841 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.127878 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260924 17:37:52.128306 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.128221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47242)
0924 17:37:52.128263 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.128288 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260924 17:37:52.128412 28955 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:45381: Network error: Client connection negotiation failed: client connection to 127.6.37.60:45381: connect: Connection refused (error 111)
I20260924 17:37:52.142181 28962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:52.144033 28962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:52.144196 28962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:52.148106 28962 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.60:45381
I20260924 17:37:52.148157 29030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.60:45381 every 8 connection(s)
I20260924 17:37:52.148488 28962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
I20260924 17:37:52.149566 29031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:52.151175 29031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:52.152093 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 28962
I20260924 17:37:52.152192 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790271173812085-6292-0/minicluster-data/master-2/wal/instance
I20260924 17:37:52.152383 6292 external_mini_cluster.cc:1428] Setting key 3d77efeaaf60228b8e090ab5f3d27a19
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271472, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:37:52.161119 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.151848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48762 (local address 127.6.37.62:35083)
0924 17:37:52.151947 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.151950 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.152180 (+ 230us) server_negotiation.cc:407] Connection header received
0924 17:37:52.152839 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.152840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.152851 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.152919 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.153594 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.154129 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.155290 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.155594 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.155668 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.157992 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.157994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.157994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.158001 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.159707 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.160099 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.160100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.160101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.160164 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.160403 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.160404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.160405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.160541 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.160591 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.160929 (+ 338us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.161032 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260924 17:37:52.161258 29033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.151829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:35083 (local address 127.0.0.1:48762)
0924 17:37:52.152018 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.152070 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.152720 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.153046 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.153051 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.153356 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.153500 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.153505 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.154207 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.154208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.155214 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.155216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.155713 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.155714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.155854 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.156377 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.156385 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.157890 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.159781 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.159788 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.159790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.160022 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.160247 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.160248 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.160248 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.160340 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.160607 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.160615 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.160779 (+ 164us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.160899 (+ 120us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.161065 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":103,"thread_start_us":90,"threads_started":1}
I20260924 17:37:52.161655 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.152778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47258 (local address 127.6.37.60:45381)
0924 17:37:52.152955 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.152959 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.152978 (+ 19us) server_negotiation.cc:407] Connection header received
0924 17:37:52.153045 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.153046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.153065 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.153148 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.153741 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.154808 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.155725 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.156136 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.156189 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.158736 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.158743 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.158744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.158750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.160351 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.160734 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.160737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.160737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.160784 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.160983 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.160984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.160985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.161142 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.161280 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.161470 (+ 190us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.161547 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":99,"threads_started":1}
I20260924 17:37:52.162140 29031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271472, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:52.168874 29033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.162404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:34837 (local address 127.0.0.1:44900)
0924 17:37:52.162434 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.162443 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.162477 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.162640 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.162641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.162769 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.162796 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.162797 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.163434 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.163435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.163899 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.163900 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.164316 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.164317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.164377 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.164780 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.164786 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.166111 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.167838 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.167839 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.167840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.168016 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.168242 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.168243 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.168243 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.168304 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.168568 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.168569 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.168611 (+ 42us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.168696 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.168784 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14}
I20260924 17:37:52.168874 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.162456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44900 (local address 127.6.37.61:34837)
0924 17:37:52.162518 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.162520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.162529 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:52.162552 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.162553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.162562 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.162626 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.162895 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.163353 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.164004 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.164230 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.164315 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.166193 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.166195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.166195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.166204 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.167748 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.168104 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.168106 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.168106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.168165 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.168373 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.168374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.168374 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.168490 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.168561 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.168722 (+ 161us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.168788 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260924 17:37:52.169418 29031 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:52.169829 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.162371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48776 (local address 127.6.37.62:35083)
0924 17:37:52.162458 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.162460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.162468 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:52.162556 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.162557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.162567 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.162614 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.163124 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.163556 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.164197 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.164392 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.164490 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.167130 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.167131 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.167132 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.167138 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.168492 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.168845 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.168846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.168847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.168897 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.169137 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.169138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.169138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.169259 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.169403 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.169623 (+ 220us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.169722 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260924 17:37:52.172091 28880 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } attempt: 2
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271472, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:37:52.176569 29035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.169691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47266 (local address 127.6.37.60:45381)
0924 17:37:52.169779 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.169781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.169790 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:52.169809 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.169810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.169820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.169862 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.170173 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.170726 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.171408 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.171630 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.171715 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.173710 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.173712 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.173712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.173719 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.175275 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.175784 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.175785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.175786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.175836 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.176051 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.176052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.176052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.176175 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.176241 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.176373 (+ 132us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.176488 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":69}
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:37:52.176786 29033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.169661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47266)
0924 17:37:52.169706 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.169716 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.169757 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.169877 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.169877 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.170034 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.170066 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.170068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.170793 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.170794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.171311 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.171313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.171716 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.171716 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.171765 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.172162 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.172167 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.173396 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.175330 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.175331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.175331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.175689 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.175912 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.175913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.175913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.175983 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.176233 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.176233 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.176272 (+ 39us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.176338 (+ 66us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.176433 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260924 17:37:52.178601 29031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: Bootstrap starting.
I20260924 17:37:52.179075 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.170402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44906 (local address 127.6.37.61:34837)
0924 17:37:52.170440 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.170441 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.170859 (+ 418us) server_negotiation.cc:407] Connection header received
0924 17:37:52.170962 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.170963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.170972 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.171018 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.171458 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.171926 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.172854 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.173161 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.173224 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.175753 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.175754 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.175755 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.175761 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.177448 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.178076 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.178077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.178078 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.178135 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.178378 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.178379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.178380 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.178524 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.178692 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.178762 (+ 70us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.178836 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:52.179435 29031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:52.179780 29031 log.cc:824] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:52.179915 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.172297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47270)
0924 17:37:52.172337 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.172345 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.172376 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.172749 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.172750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.172915 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.172945 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.172946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.173743 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.173744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.174628 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.174631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.175168 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.175169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.175234 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.175548 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.175554 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.176925 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.178795 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.178796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.178797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.179042 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.179230 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.179231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.179231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.179290 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.179596 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.179596 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.179643 (+ 47us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.179716 (+ 73us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.179816 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260924 17:37:52.179962 29037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.172479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.6.37.60:45381)
0924 17:37:52.172614 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.172616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.172624 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:52.172644 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.172644 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.172653 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.172724 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.173020 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.173658 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.174705 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.175083 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.175159 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.177032 (+ 1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.177033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.177033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.177041 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.178708 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.179125 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.179126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.179126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.179179 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.179365 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.179366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.179366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.179524 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.179608 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.179764 (+ 156us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.179839 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
I20260924 17:37:52.180445 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:52.180719 29031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: No bootstrap required, opened a new log
I20260924 17:37:52.181324 28854 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "20533fea886241dda5579322bb7896ac"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48776
I20260924 17:37:52.182111 28880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac: Bootstrap starting.
I20260924 17:37:52.182667 28880 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:52.183003 28880 log.cc:824] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:52.183790 28880 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac: No bootstrap required, opened a new log
I20260924 17:37:52.184633 29031 raft_consensus.cc:348] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.184791 29031 raft_consensus.cc:729] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 920152bf0e1d469891c8cc567524f1a8, State: Initialized, Role: FOLLOWER
I20260924 17:37:52.184885 29031 consensus_queue.cc:260] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.185184 29031 sys_catalog.cc:564] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:52.185150 29040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.185168 28880 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.185294 28880 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20533fea886241dda5579322bb7896ac, State: Initialized, Role: FOLLOWER
I20260924 17:37:52.185322 29040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.185395 28880 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.185643 29041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.185732 28854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260924 17:37:52.185686 28880 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:52.185793 28854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:52.186626 28854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.186857 28854 leader_election.cc:288] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [CANDIDATE]: Term 1 election: Requested vote from peers 2e10165f286a43f09cef1ffd7eb521f9 (127.6.37.61:34837), 920152bf0e1d469891c8cc567524f1a8 (127.6.37.60:45381)
W20260924 17:37:52.187069 29058 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:52.187116 29058 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:52.187496 29041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.187706 29005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20533fea886241dda5579322bb7896ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "920152bf0e1d469891c8cc567524f1a8"
I20260924 17:37:52.187819 29005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [term 0 FOLLOWER]: Advancing to term 1
W20260924 17:37:52.188531 29065 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:52.188601 29065 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:52.188764 29005 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20533fea886241dda5579322bb7896ac in term 1.
I20260924 17:37:52.188953 28829 leader_election.cc:302] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20533fea886241dda5579322bb7896ac, 920152bf0e1d469891c8cc567524f1a8; no voters:
I20260924 17:37:52.189109 28962 master_runner.cc:186] Error getting master registration for 127.6.37.61:34837: OK, instance_id { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" instance_seqno: 1790271471984988 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 17:37:52.190829 28962 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 17:37:52.191026 29041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:52.191190 29041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [term 1 LEADER]: Becoming Leader. State: Replica: 20533fea886241dda5579322bb7896ac, State: Running, Role: LEADER
I20260924 17:37:52.191272 29041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.191675 29041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20533fea886241dda5579322bb7896ac. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.191766 29041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:52.189759 28812 master_runner.cc:186] Error getting master registration for 127.6.37.61:34837: OK, instance_id { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" instance_seqno: 1790271471984988 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 17:37:52.193238 28812 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 17:37:52.195077 29076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:52.195305 29076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:52.198028 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.188923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48782 (local address 127.6.37.62:35083)
0924 17:37:52.188960 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.188962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.191048 (+ 2086us) server_negotiation.cc:407] Connection header received
0924 17:37:52.191120 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.191121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.191131 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.191183 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.191871 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.192442 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.193137 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.193341 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.193427 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.194715 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.194716 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.194716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.194723 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.196444 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.196842 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.196843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.196843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.196896 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.197079 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.197080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.197080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.197198 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.197277 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.197859 (+ 582us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.197943 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:52.204715 29037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.189293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47272 (local address 127.6.37.60:45381)
0924 17:37:52.189381 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.189383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.195030 (+ 5647us) server_negotiation.cc:407] Connection header received
0924 17:37:52.195123 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.195124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.195135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.195184 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.196256 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.197009 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.199780 (+ 2771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.200100 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.200142 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.201671 (+ 1529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.201672 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.201672 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.201679 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.203461 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.203861 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.203862 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.203862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.203916 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.204116 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.204117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.204117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.204236 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.204325 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.204537 (+ 212us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.204628 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260924 17:37:52.205778 29005 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [term 1 FOLLOWER]: Refusing update from remote peer 20533fea886241dda5579322bb7896ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:52.206601 29041 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:52.207566 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.189201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44912 (local address 127.6.37.61:34837)
0924 17:37:52.189236 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.189238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.197762 (+ 8524us) server_negotiation.cc:407] Connection header received
0924 17:37:52.198152 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.198153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.198165 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.198197 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.198928 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.199637 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.201056 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.201373 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.201416 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.203723 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.203724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.203725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.203733 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.205752 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.206389 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.206391 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.206391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.206449 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.206834 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.206835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.206835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.206998 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.207096 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.207390 (+ 294us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.207463 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:52.207952 29040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20533fea886241dda5579322bb7896ac. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.208063 29040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.212742 29074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.212841 29074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:52.213301 29076 catalog_manager.cc:1347] Generated new cluster ID: ea96cd8d2c5545e399bce9daffbcee50
I20260924 17:37:52.213356 29076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:52.213838 29078 mvcc.cc:205] Tried to move back new op lower bound from 7332951950151143424 to 7332951950096138240. Current Snapshot: MvccSnapshot[applied={T|T < 7332951950151143424}]
I20260924 17:37:52.219244 29040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.219336 29040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.219566 28955 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } attempt: 3
Sep 24 17:37:52 dist-test-slave-gcz9 krb5kdc[28799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271471, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:37:52.227864 28957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.219795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:45381 (local address 127.0.0.1:47282)
0924 17:37:52.219840 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:52.219854 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:52.219905 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:52.220044 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:52.220045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:52.220223 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:52.220273 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.220275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.221133 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.221134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.221953 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:52.221955 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.222444 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.222445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:52.222514 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.223023 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:52.223028 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:52.225106 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:52.226806 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.226807 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.226807 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.227034 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.227246 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:52.227247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:52.227247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:52.227311 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:52.227568 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:52.227569 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:52.227623 (+ 54us) client_negotiation.cc:769] Sending connection context
0924 17:37:52.227679 (+ 56us) client_negotiation.cc:240] Negotiation successful
0924 17:37:52.227769 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260924 17:37:52.228395 29037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.219908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47282 (local address 127.6.37.60:45381)
0924 17:37:52.219946 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.219948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.219956 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:52.219977 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.219977 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.219986 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.220039 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.220352 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.221067 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.222062 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.222378 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.222442 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.225184 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:52.225186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:52.225186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:52.225193 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:52.226733 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.227111 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.227112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.227112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.227166 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:52.227364 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:52.227365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:52.227365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:52.227476 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:52.227533 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.228241 (+ 708us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.228315 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:52.229965 28955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: Bootstrap starting.
I20260924 17:37:52.230654 28955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:52.231036 28955 log.cc:824] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:52.235750 28955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: No bootstrap required, opened a new log
I20260924 17:37:52.237934 28955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.238083 28955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e10165f286a43f09cef1ffd7eb521f9, State: Initialized, Role: FOLLOWER
I20260924 17:37:52.238171 28955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } }
I20260924 17:37:52.238571 29076 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:52.238480 29083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.238601 28928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:52.238942 29083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.239707 28928 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [term 1 FOLLOWER]: Refusing update from remote peer 20533fea886241dda5579322bb7896ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:52.240173 29074 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:52.238628 28929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "20533fea886241dda5579322bb7896ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2e10165f286a43f09cef1ffd7eb521f9"
I20260924 17:37:52.240918 28929 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20533fea886241dda5579322bb7896ac in term 1.
I20260924 17:37:52.242534 29083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20533fea886241dda5579322bb7896ac. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.242617 29083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.238545 28955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:52.243116 29086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.243323 29086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:52.244088 29076 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:52.248533 29041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "20533fea886241dda5579322bb7896ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20533fea886241dda5579322bb7896ac" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 35083 } } peers { permanent_uuid: "2e10165f286a43f09cef1ffd7eb521f9" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 34837 } } peers { permanent_uuid: "920152bf0e1d469891c8cc567524f1a8" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 45381 } } }
I20260924 17:37:52.248639 29041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:52.250029 29076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20533fea886241dda5579322bb7896ac: Generated new TSK 0
I20260924 17:37:52.250241 29076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260924 17:37:52.255686 29099 catalog_manager.cc:1259] Loaded cluster ID: ea96cd8d2c5545e399bce9daffbcee50
I20260924 17:37:52.255735 29099 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: loading cluster ID for follower catalog manager: success
I20260924 17:37:52.256852 29099 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: acquiring CA information for follower catalog manager: success
I20260924 17:37:52.257193 29099 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2e10165f286a43f09cef1ffd7eb521f9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260924 17:37:52.278733 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.277255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48796 (local address 127.6.37.62:35083)
0924 17:37:52.277299 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.277301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.278116 (+ 815us) server_negotiation.cc:407] Connection header received
0924 17:37:52.278220 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.278221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.278231 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.278261 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.278665 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48796: BlockingRecv error: recv got EOF from 127.0.0.1:48796 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260924 17:37:52.279518 28959 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.277497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44928 (local address 127.6.37.61:34837)
0924 17:37:52.277537 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.277539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.278982 (+ 1443us) server_negotiation.cc:407] Connection header received
0924 17:37:52.279092 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.279093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.279103 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.279132 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.279459 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44928: BlockingRecv error: recv got EOF from 127.0.0.1:44928 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260924 17:37:52.280279 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.277805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47286 (local address 127.6.37.60:45381)
0924 17:37:52.277841 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.277842 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.279754 (+ 1912us) server_negotiation.cc:407] Connection header received
0924 17:37:52.279846 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.279848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.279857 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.279885 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.280220 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47286: BlockingRecv error: recv got EOF from 127.0.0.1:47286 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:52.285271 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.281812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44934 (local address 127.6.37.61:34837)
0924 17:37:52.281844 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.281846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.282034 (+ 188us) server_negotiation.cc:407] Connection header received
0924 17:37:52.282135 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.282136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.282169 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.282210 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.282392 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.283185 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.284340 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.284637 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.284679 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.284894 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.285026 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.285076 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.285189 (+ 113us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.285206 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260924 17:37:52.288422 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.287611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47296 (local address 127.6.37.60:45381)
0924 17:37:52.287645 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.287646 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.287878 (+ 232us) server_negotiation.cc:407] Connection header received
0924 17:37:52.287985 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.287986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.288015 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.288046 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.288377 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47296: BlockingRecv error: recv got EOF from 127.0.0.1:47296 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:52.293720 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.290548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44940 (local address 127.6.37.61:34837)
0924 17:37:52.290580 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.290581 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.290801 (+ 220us) server_negotiation.cc:407] Connection header received
0924 17:37:52.290918 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.290919 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.290927 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.290954 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.291125 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.291837 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.292944 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.293250 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.293288 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.293475 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.293506 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.293533 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.293633 (+ 100us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.293649 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260924 17:37:52.296685 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.295968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47306 (local address 127.6.37.60:45381)
0924 17:37:52.296017 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.296018 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.296211 (+ 193us) server_negotiation.cc:407] Connection header received
0924 17:37:52.296307 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.296308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.296318 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.296346 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.296636 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47306: BlockingRecv error: recv got EOF from 127.0.0.1:47306 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:52.302851 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.299727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44956 (local address 127.6.37.61:34837)
0924 17:37:52.299761 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.299763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.299984 (+ 221us) server_negotiation.cc:407] Connection header received
0924 17:37:52.300093 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.300093 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.300101 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.300128 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.300284 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.301007 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.302096 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.302388 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.302425 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.302609 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.302641 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.302668 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.302767 (+ 99us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.302783 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260924 17:37:52.306341 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.305490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47308 (local address 127.6.37.60:45381)
0924 17:37:52.305528 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.305529 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.305746 (+ 217us) server_negotiation.cc:407] Connection header received
0924 17:37:52.305844 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.305845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.305858 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.305887 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.306282 (+ 395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47308: BlockingRecv error: recv got EOF from 127.0.0.1:47308 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:52.314785 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.311546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44968 (local address 127.6.37.61:34837)
0924 17:37:52.311582 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.311584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.311815 (+ 231us) server_negotiation.cc:407] Connection header received
0924 17:37:52.311909 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.311910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.311918 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.311946 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.312110 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.312861 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.313979 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.314269 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.314319 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.314524 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.314569 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.314596 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.314698 (+ 102us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.314715 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260924 17:37:52.317720 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.317004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47324 (local address 127.6.37.60:45381)
0924 17:37:52.317042 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.317044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.317217 (+ 173us) server_negotiation.cc:407] Connection header received
0924 17:37:52.317323 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.317324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.317334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.317363 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.317667 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47324: BlockingRecv error: recv got EOF from 127.0.0.1:47324 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:52.330031 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.326812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44976 (local address 127.6.37.61:34837)
0924 17:37:52.326859 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.326861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.327143 (+ 282us) server_negotiation.cc:407] Connection header received
0924 17:37:52.327236 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.327237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.327245 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.327273 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.327449 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.328121 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.329227 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.329551 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.329592 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.329784 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.329816 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.329843 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.329944 (+ 101us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.329960 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260924 17:37:52.332923 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.332209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47326 (local address 127.6.37.60:45381)
0924 17:37:52.332247 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.332249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.332439 (+ 190us) server_negotiation.cc:407] Connection header received
0924 17:37:52.332533 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.332534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.332544 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.332573 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.332873 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47326: BlockingRecv error: recv got EOF from 127.0.0.1:47326 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:52.353482 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.350135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44990 (local address 127.6.37.61:34837)
0924 17:37:52.350176 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.350178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.350472 (+ 294us) server_negotiation.cc:407] Connection header received
0924 17:37:52.350574 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.350575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.350585 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.350614 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.350791 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.351547 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.352652 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.352932 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.352980 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.353192 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.353226 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.353255 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.353382 (+ 127us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.353404 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260924 17:37:52.356673 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.355885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47336 (local address 127.6.37.60:45381)
0924 17:37:52.355926 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.355928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.356123 (+ 195us) server_negotiation.cc:407] Connection header received
0924 17:37:52.356221 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.356222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.356233 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.356263 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.356618 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47336: BlockingRecv error: recv got EOF from 127.0.0.1:47336 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260924 17:37:52.398617 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.395383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45002 (local address 127.6.37.61:34837)
0924 17:37:52.395431 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.395433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.395615 (+ 182us) server_negotiation.cc:407] Connection header received
0924 17:37:52.395682 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.395683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.395696 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.395762 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.395923 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.396613 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.397800 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.398096 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.398161 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.398346 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.398381 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.398427 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.398507 (+ 80us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.398526 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260924 17:37:52.403942 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.403179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47348 (local address 127.6.37.60:45381)
0924 17:37:52.403220 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.403222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.403380 (+ 158us) server_negotiation.cc:407] Connection header received
0924 17:37:52.403418 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.403419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.403450 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.403510 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.403885 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47348: BlockingRecv error: recv got EOF from 127.0.0.1:47348 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:52.471184 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.468992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45004 (local address 127.6.37.61:34837)
0924 17:37:52.469059 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.469061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.469148 (+ 87us) server_negotiation.cc:407] Connection header received
0924 17:37:52.469198 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.469199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.469209 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.469271 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.469392 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.469883 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.470609 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.470786 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.470834 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.470985 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.471014 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.471055 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.471106 (+ 51us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.471122 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260924 17:37:52.473416 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.472887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47360 (local address 127.6.37.60:45381)
0924 17:37:52.472979 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.472980 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.472989 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:52.473017 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.473018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.473026 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.473071 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.473362 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47360: BlockingRecv error: recv got EOF from 127.0.0.1:47360 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260924 17:37:52.605283 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.602629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45016 (local address 127.6.37.61:34837)
0924 17:37:52.602724 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.602727 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.602824 (+ 97us) server_negotiation.cc:407] Connection header received
0924 17:37:52.602971 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.602972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.602984 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.603061 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.603203 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.603706 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.604503 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.604757 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.604832 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.604985 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.605024 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.605076 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.605159 (+ 83us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.605179 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260924 17:37:52.607733 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.607075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47376 (local address 127.6.37.60:45381)
0924 17:37:52.607148 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.607150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.607207 (+ 57us) server_negotiation.cc:407] Connection header received
0924 17:37:52.607286 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.607287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.607298 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.607355 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.607673 (+ 318us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47376: BlockingRecv error: recv got EOF from 127.0.0.1:47376 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260924 17:37:52.867496 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:52.864961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45020 (local address 127.6.37.61:34837)
0924 17:37:52.865031 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.865034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.865148 (+ 114us) server_negotiation.cc:407] Connection header received
0924 17:37:52.865191 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.865192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.865201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.865253 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:52.865396 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.865935 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.866804 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:52.867000 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:52.867051 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:52.867206 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:52.867233 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:52.867270 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:52.867362 (+ 92us) server_negotiation.cc:299] Negotiation successful
0924 17:37:52.867378 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260924 17:37:52.869979 29037 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:52.869330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47378 (local address 127.6.37.60:45381)
0924 17:37:52.869401 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:52.869403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:52.869412 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:52.869466 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:52.869467 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:52.869480 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:52.869550 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:52.869912 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47378: BlockingRecv error: recv got EOF from 127.0.0.1:47378 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260924 17:37:53.187590 29058 catalog_manager.cc:1259] Loaded cluster ID: ea96cd8d2c5545e399bce9daffbcee50
I20260924 17:37:53.187669 29058 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: loading cluster ID for follower catalog manager: success
I20260924 17:37:53.188519 29058 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: acquiring CA information for follower catalog manager: success
I20260924 17:37:53.188877 29058 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 920152bf0e1d469891c8cc567524f1a8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 17:37:53.385402 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:53.383062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45034 (local address 127.6.37.61:34837)
0924 17:37:53.383173 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:53.383175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:53.383187 (+ 12us) server_negotiation.cc:407] Connection header received
0924 17:37:53.383262 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:53.383263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:53.383274 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:53.383344 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:53.383470 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.383964 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.384768 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.384959 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.385024 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:53.385147 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:53.385179 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:53.385221 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:53.385268 (+ 47us) server_negotiation.cc:299] Negotiation successful
0924 17:37:53.385287 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":58,"threads_started":1}
I20260924 17:37:53.389604 29222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:53.387319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47386 (local address 127.6.37.60:45381)
0924 17:37:53.387418 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:53.387419 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:53.387428 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:53.387545 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:53.387546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:53.387621 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:53.387688 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:53.387774 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.388234 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.388876 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.389064 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.389113 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:53.389230 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:53.389334 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:53.389386 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:53.389417 (+ 31us) server_negotiation.cc:299] Negotiation successful
0924 17:37:53.389432 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":54,"threads_started":1}
I20260924 17:37:53.394254 29222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:53.391386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47390 (local address 127.6.37.60:45381)
0924 17:37:53.391419 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:53.391421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:53.391618 (+ 197us) server_negotiation.cc:407] Connection header received
0924 17:37:53.391716 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:53.391716 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:53.391726 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:53.391755 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:53.391952 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.392401 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.393420 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.393696 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.393752 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:53.393952 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:53.393984 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:53.394043 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:53.394141 (+ 98us) server_negotiation.cc:299] Negotiation successful
0924 17:37:53.394161 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:53.394268 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:53.391241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45040 (local address 127.6.37.61:34837)
0924 17:37:53.391341 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:53.391343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:53.391462 (+ 119us) server_negotiation.cc:407] Connection header received
0924 17:37:53.391587 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:53.391589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:53.391601 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:53.391656 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:53.391803 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.392560 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.393549 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.393818 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.393873 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:53.394028 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:53.394063 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:53.394113 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:53.394166 (+ 53us) server_negotiation.cc:299] Negotiation successful
0924 17:37:53.394189 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260924 17:37:53.394364 29229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:53.391219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48812 (local address 127.6.37.62:35083)
0924 17:37:53.391347 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:53.391350 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:53.391451 (+ 101us) server_negotiation.cc:407] Connection header received
0924 17:37:53.391567 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:53.391568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:53.391622 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:53.391719 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:53.391885 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.392632 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.393353 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:53.393652 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:53.393718 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:53.393894 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:53.394010 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:53.394071 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:53.394249 (+ 178us) server_negotiation.cc:299] Negotiation successful
0924 17:37:53.394275 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260924 17:37:53.396143 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28812
I20260924 17:37:53.401754 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28887
I20260924 17:37:53.406919 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 28962
2026-09-24T17:37:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2860 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 24 17:37:53 dist-test-slave-gcz9 krb5kdc[29233](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 24 17:37:53 dist-test-slave-gcz9 krb5kdc[29233](info): set up 2 sockets
Sep 24 17:37:53 dist-test-slave-gcz9 krb5kdc[29233](info): commencing operation
krb5kdc: starting...
W20260924 17:37:54.452920 6292 mini_kdc.cc:121] Time spent starting KDC: real 1.026s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/test-user.keytab.
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-24T17:37:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-24T17:37:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.6.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
Entry for principal kudu/127.6.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab.
I20260924 17:37:54.569604 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45251
--webserver_interface=127.6.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:45251,127.6.37.61:32979,127.6.37.60:36919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260924 17:37:54.650043 29246 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 17:37:54.650288 29246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:54.650318 29246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:54.650362 29246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:54.651525 29246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:54.651597 29246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:54.651623 29246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:54.651656 29246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:54.651687 29246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:54.653637 29246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:45251,127.6.37.61:32979,127.6.37.60:36919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.62.keytab
--principal=kudu/127.6.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.62:45251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:54.653942 29246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:54.654198 29246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260924 17:37:54.659693 29246 server_base.cc:1034] running on GCE node
W20260924 17:37:54.659646 29254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:54.659631 29251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:54.659605 29252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:54.660063 29246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:54.660317 29246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:54.661458 29246 hybrid_clock.cc:648] HybridClock initialized: now 1790271474661441 us; error 33 us; skew 500 ppm
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:54.664062 29246 init.cc:377] Logged in from keytab as kudu/127.6.37.62@KRBTEST.COM (short username kudu)
I20260924 17:37:54.664484 29246 webserver.cc:460] Webserver started at http://127.6.37.62:44317/ using document root <none> and password file <none>
I20260924 17:37:54.664726 29246 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:54.664798 29246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:54.664947 29246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:54.666007 29246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data/instance:
uuid: "c8b3a2d9fa344d0fbece96e9c1613495"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "316d3ce8ec13e74026fa4b169aea6026"
server_key_iv: "a9d5c7478fe6f9cc60a27a77d3bc92d3"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.666368 29246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal/instance:
uuid: "c8b3a2d9fa344d0fbece96e9c1613495"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "316d3ce8ec13e74026fa4b169aea6026"
server_key_iv: "a9d5c7478fe6f9cc60a27a77d3bc92d3"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.667757 29246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260924 17:37:54.668552 29262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:54.668720 29246 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:54.668825 29246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal
uuid: "c8b3a2d9fa344d0fbece96e9c1613495"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "316d3ce8ec13e74026fa4b169aea6026"
server_key_iv: "a9d5c7478fe6f9cc60a27a77d3bc92d3"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.668926 29246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:54.679483 29246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:54.681682 29246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:54.681840 29246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:54.685739 29246 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.62:45251
I20260924 17:37:54.685792 29314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.62:45251 every 8 connection(s)
I20260924 17:37:54.686147 29246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/data/info.pb
I20260924 17:37:54.687209 29315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:54.688735 29315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:54.694181 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 29246
I20260924 17:37:54.694262 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-0/wal/instance
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:54.694455 6292 external_mini_cluster.cc:1428] Setting key 1b4716c2c639cd6a0cd0613cb0c04a0c
I20260924 17:37:54.697870 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.689333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45251 (local address 127.0.0.1:45512)
0924 17:37:54.689496 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.689548 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:54.689987 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:54.690279 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:54.690281 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:54.690534 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:54.690686 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.690689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.691713 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.691714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.692370 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.692372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.692825 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.692826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.692880 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.693290 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:54.693298 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:54.694692 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:54.696484 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.696490 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.696498 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.696686 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.696954 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.696955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.696955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.697041 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.697466 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:54.697472 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:54.697527 (+ 55us) client_negotiation.cc:769] Sending connection context
0924 17:37:54.697599 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:37:54.697721 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":61,"threads_started":1}
I20260924 17:37:54.697985 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.689414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45512 (local address 127.6.37.62:45251)
0924 17:37:54.689569 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:54.689573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:54.689616 (+ 43us) server_negotiation.cc:407] Connection header received
0924 17:37:54.690148 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:54.690150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:54.690167 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:54.690252 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:54.690771 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.691635 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.692442 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.692735 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.692817 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.694777 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:54.694784 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:54.694785 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:54.694791 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:54.696381 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.696783 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.696787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.696787 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.696883 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.697113 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.697114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.697114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.697395 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:54.697479 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:54.697653 (+ 174us) server_negotiation.cc:299] Negotiation successful
0924 17:37:54.697805 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":101,"thread_start_us":76,"threads_started":1}
I20260924 17:37:54.698699 29315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:54.699071 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.698963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37664)
0924 17:37:54.699009 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.699054 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260924 17:37:54.699187 29266 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
I20260924 17:37:54.699585 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.699490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37674)
0924 17:37:54.699541 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.699564 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260924 17:37:54.699682 29315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:32979: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.6.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab.
Entry for principal kudu/127.6.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab.
I20260924 17:37:54.717552 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:32979
--webserver_interface=127.6.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab
--principal=kudu/127.6.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:45251,127.6.37.61:32979,127.6.37.60:36919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:54.748898 29315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } attempt: 1
I20260924 17:37:54.749372 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.749234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37686)
0924 17:37:54.749301 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.749340 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260924 17:37:54.749816 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.749724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37690)
0924 17:37:54.749771 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.749797 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:37:54.749938 29315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:32979: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
W20260924 17:37:54.797603 29322 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 17:37:54.797802 29322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:54.797818 29322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:54.797838 29322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:54.798892 29322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:54.798923 29322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:54.798936 29322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:54.798949 29322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:54.798961 29322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:54.800328 29322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:45251,127.6.37.61:32979,127.6.37.60:36919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.61.keytab
--principal=kudu/127.6.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.61:32979
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.6.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:54.800518 29322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:54.800676 29322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:54.805263 29327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:54.805269 29330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:54.805271 29328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:54.805521 29322 server_base.cc:1034] running on GCE node
I20260924 17:37:54.805835 29322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:54.806064 29322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:54.807200 29322 hybrid_clock.cc:648] HybridClock initialized: now 1790271474807191 us; error 27 us; skew 500 ppm
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:54.809640 29322 init.cc:377] Logged in from keytab as kudu/127.6.37.61@KRBTEST.COM (short username kudu)
I20260924 17:37:54.810105 29322 webserver.cc:460] Webserver started at http://127.6.37.61:33037/ using document root <none> and password file <none>
I20260924 17:37:54.810323 29322 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:54.810389 29322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:54.810534 29322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:54.811661 29322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data/instance:
uuid: "2713838e061a43ad9a467646ecc71fd6"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "1b2cd5d802126f8799601946ded119a3"
server_key_iv: "84a4290c49adcf9e6dfdda3f73a9fd49"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.812022 29322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal/instance:
uuid: "2713838e061a43ad9a467646ecc71fd6"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "1b2cd5d802126f8799601946ded119a3"
server_key_iv: "84a4290c49adcf9e6dfdda3f73a9fd49"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.813370 29322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260924 17:37:54.814056 29337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:54.814227 29322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:54.814330 29322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal
uuid: "2713838e061a43ad9a467646ecc71fd6"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "1b2cd5d802126f8799601946ded119a3"
server_key_iv: "84a4290c49adcf9e6dfdda3f73a9fd49"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.814404 29322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:54.818110 29315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } attempt: 2
I20260924 17:37:54.818492 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.818360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37698)
0924 17:37:54.818418 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.818455 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260924 17:37:54.818799 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.818706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37706)
0924 17:37:54.818752 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.818776 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260924 17:37:54.818924 29315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.61:32979: Network error: Client connection negotiation failed: client connection to 127.6.37.61:32979: connect: Connection refused (error 111)
I20260924 17:37:54.826159 29322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:54.828485 29322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:54.828645 29322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:54.832620 29322 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.61:32979
I20260924 17:37:54.832655 29389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.61:32979 every 8 connection(s)
I20260924 17:37:54.832983 29322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/data/info.pb
I20260924 17:37:54.833914 29390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:54.835453 29390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:54.841981 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 29322
I20260924 17:37:54.842090 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-1/wal/instance
I20260924 17:37:54.842298 6292 external_mini_cluster.cc:1428] Setting key 3106fff2283845adb34a336cf4fb3389
I20260924 17:37:54.844218 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.836101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45528 (local address 127.6.37.62:45251)
0924 17:37:54.836152 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:54.836155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:54.836361 (+ 206us) server_negotiation.cc:407] Connection header received
0924 17:37:54.836875 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:54.836876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:54.836892 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:54.836948 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:54.837550 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.838030 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.839062 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.839267 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.839351 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.841298 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:54.841299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:54.841300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:54.841306 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:54.842669 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.843174 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.843175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.843175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.843225 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.843508 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.843508 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.843508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.843605 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:54.843691 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:54.844005 (+ 314us) server_negotiation.cc:299] Negotiation successful
0924 17:37:54.844099 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260924 17:37:54.844231 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.836075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45251 (local address 127.0.0.1:45528)
0924 17:37:54.836250 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.836284 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:54.836760 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:54.837034 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:54.837037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:54.837259 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:54.837444 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.837448 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.838134 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.838140 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.838979 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.838982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.839373 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.839375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.839502 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.839954 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:54.839962 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:54.841216 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:54.842750 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.842758 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.842760 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.843103 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.843291 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.843291 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.843292 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.843436 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.843696 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:54.843704 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:54.843879 (+ 175us) client_negotiation.cc:769] Sending connection context
0924 17:37:54.843964 (+ 85us) client_negotiation.cc:240] Negotiation successful
0924 17:37:54.844080 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":82,"threads_started":1}
I20260924 17:37:54.845131 29390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
WARNING: no policy specified for kudu/127.6.37.60@KRBTEST.COM; defaulting to no policy
I20260924 17:37:54.852419 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.845358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37712)
0924 17:37:54.845407 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.845417 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:54.845458 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:54.845714 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:54.845715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:54.845820 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:54.845864 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.845866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.847180 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.847180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.847673 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.847675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.848326 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.848327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.848379 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.848764 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:54.848768 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:54.849857 (+ 1089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:54.851576 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.851577 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.851578 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.851746 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.851923 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.851923 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.851924 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.851976 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.852201 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:54.852201 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:54.852234 (+ 33us) client_negotiation.cc:769] Sending connection context
0924 17:37:54.852284 (+ 50us) client_negotiation.cc:240] Negotiation successful
0924 17:37:54.852358 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260924 17:37:54.852514 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.845410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37712 (local address 127.6.37.61:32979)
0924 17:37:54.845564 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:54.845569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:54.845590 (+ 21us) server_negotiation.cc:407] Connection header received
0924 17:37:54.845613 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:54.845615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:54.845629 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:54.845705 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:54.845941 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.847103 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.847753 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.848245 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.848325 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.849941 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:54.849950 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:54.849950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:54.849957 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:54.851477 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.851814 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.851817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.851817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.851866 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.852027 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.852027 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.852028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.852147 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:54.852206 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:54.852325 (+ 119us) server_negotiation.cc:299] Negotiation successful
0924 17:37:54.852404 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.6.37.60@KRBTEST.COM" created.
I20260924 17:37:54.853096 29390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:54.853452 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.853309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40576)
0924 17:37:54.853357 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.853423 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260924 17:37:54.853624 29338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
I20260924 17:37:54.854058 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.853948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40584)
0924 17:37:54.853997 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.854026 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:37:54.854210 29390 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:36919: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.6.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab.
Entry for principal kudu/127.6.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab.
I20260924 17:37:54.867777 6292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskzK0f6g/build/release/bin/kudu
/tmp/dist-test-taskzK0f6g/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:36919
--webserver_interface=127.6.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab
--principal=kudu/127.6.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.6.37.20:37229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.37.62:45251,127.6.37.61:32979,127.6.37.60:36919
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260924 17:37:54.903475 29390 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } attempt: 1
I20260924 17:37:54.904043 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.903866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40598)
0924 17:37:54.903943 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.903995 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260924 17:37:54.904440 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.904328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40610)
0924 17:37:54.904378 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.904416 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:37:54.904572 29390 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:36919: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
I20260924 17:37:54.910079 29315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } attempt: 3
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:37:54.916917 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.910467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37714 (local address 127.6.37.61:32979)
0924 17:37:54.910532 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:54.910535 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:54.910558 (+ 23us) server_negotiation.cc:407] Connection header received
0924 17:37:54.910592 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:54.910593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:54.910601 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:54.910657 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:54.911081 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.911596 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.912315 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.912538 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.912616 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.914400 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:54.914401 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:54.914401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:54.914409 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:54.915779 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.916140 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.916142 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.916143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.916198 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:54.916397 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:54.916398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:54.916398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:54.916516 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:54.916588 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:54.916751 (+ 163us) server_negotiation.cc:299] Negotiation successful
0924 17:37:54.916826 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260924 17:37:54.916920 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.910358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37714)
0924 17:37:54.910421 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.910433 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:54.910510 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:54.910675 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:54.910676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:54.910920 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:54.910999 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.911001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.911686 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.911687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.912226 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.912228 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.912613 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.912614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.912695 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.913161 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:54.913165 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:54.914313 (+ 1148us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:54.915876 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.915878 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.915878 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.916057 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.916274 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.916275 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.916275 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:54.916335 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:54.916592 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:54.916593 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:54.916656 (+ 63us) client_negotiation.cc:769] Sending connection context
0924 17:37:54.916728 (+ 72us) client_negotiation.cc:240] Negotiation successful
0924 17:37:54.916825 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260924 17:37:54.917263 29315 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:54.917603 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.917506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40614)
0924 17:37:54.917554 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.917580 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260924 17:37:54.918012 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.917918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40630)
0924 17:37:54.917962 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.917986 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260924 17:37:54.918118 29315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:36919: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
I20260924 17:37:54.949249 29315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } attempt: 1
I20260924 17:37:54.949690 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.949560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40634)
0924 17:37:54.949628 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.949662 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260924 17:37:54.950079 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.949930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40648)
0924 17:37:54.949998 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.950042 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260924 17:37:54.950209 29315 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:36919: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
W20260924 17:37:54.950708 29398 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260924 17:37:54.950992 29398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260924 17:37:54.951015 29398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260924 17:37:54.951035 29398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260924 17:37:54.952159 29398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260924 17:37:54.952196 29398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260924 17:37:54.952210 29398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260924 17:37:54.952224 29398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260924 17:37:54.952235 29398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260924 17:37:54.953644 29398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.37.20:37229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.6.37.62:45251,127.6.37.61:32979,127.6.37.60:36919
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/krb5kdc/kudu_127.6.37.60.keytab
--principal=kudu/127.6.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.37.60:36919
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.6.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 24 Sep 2026 16:40:09 UTC on ccycloud.quasar-meryvx.root.comops.site
build id 4670649
I20260924 17:37:54.953830 29398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260924 17:37:54.954001 29398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260924 17:37:54.958694 29404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:54.958695 29406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260924 17:37:54.958721 29403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260924 17:37:54.958721 29398 server_base.cc:1034] running on GCE node
I20260924 17:37:54.959194 29398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260924 17:37:54.959506 29398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260924 17:37:54.960688 29398 hybrid_clock.cc:648] HybridClock initialized: now 1790271474960672 us; error 43 us; skew 500 ppm
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260924 17:37:54.963294 29398 init.cc:377] Logged in from keytab as kudu/127.6.37.60@KRBTEST.COM (short username kudu)
I20260924 17:37:54.963843 29398 webserver.cc:460] Webserver started at http://127.6.37.60:42435/ using document root <none> and password file <none>
I20260924 17:37:54.964071 29398 fs_manager.cc:359] Metadata directory not provided
I20260924 17:37:54.964141 29398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260924 17:37:54.964274 29398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260924 17:37:54.965335 29398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data/instance:
uuid: "84b9f2f65d444155882b6ed47f316bf6"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "1a8e6093cd8a6e87626bb83edfefc6fc"
server_key_iv: "a65fb28d23297972e15294f32bd3816a"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.965708 29398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal/instance:
uuid: "84b9f2f65d444155882b6ed47f316bf6"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "1a8e6093cd8a6e87626bb83edfefc6fc"
server_key_iv: "a65fb28d23297972e15294f32bd3816a"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.967096 29398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260924 17:37:54.967846 29414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260924 17:37:54.968035 29398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260924 17:37:54.968137 29398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data,/tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal
uuid: "84b9f2f65d444155882b6ed47f316bf6"
format_stamp: "Formatted at 2026-09-24 17:37:54 on dist-test-slave-gcz9"
server_key: "1a8e6093cd8a6e87626bb83edfefc6fc"
server_key_iv: "a65fb28d23297972e15294f32bd3816a"
server_key_version: "encryptionkey@0"
I20260924 17:37:54.968223 29398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260924 17:37:54.972728 29390 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } attempt: 2
I20260924 17:37:54.973109 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.972997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40656)
0924 17:37:54.973051 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.973083 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260924 17:37:54.973455 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.973363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40672)
0924 17:37:54.973406 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.973437 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260924 17:37:54.973538 29390 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.6.37.60:36919: Network error: Client connection negotiation failed: client connection to 127.6.37.60:36919: connect: Connection refused (error 111)
I20260924 17:37:54.981627 29398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260924 17:37:54.983984 29398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260924 17:37:54.984136 29398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260924 17:37:54.988225 29398 rpc_server.cc:307] RPC server started. Bound to: 127.6.37.60:36919
I20260924 17:37:54.988260 29467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.37.60:36919 every 8 connection(s)
I20260924 17:37:54.988607 29398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/data/info.pb
I20260924 17:37:54.989615 29468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260924 17:37:54.991221 29468 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } has no permanent_uuid. Determining permanent_uuid...
I20260924 17:37:54.992012 6292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskzK0f6g/build/release/bin/kudu as pid 29398
I20260924 17:37:54.992144 6292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskzK0f6g/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790271173812085-6292-0/minicluster-data/master-2/wal/instance
I20260924 17:37:54.992367 6292 external_mini_cluster.cc:1428] Setting key 30a44ab9e7a044ad48419214f5c5ecd6
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
Sep 24 17:37:54 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:37:55.001376 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.991908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45540 (local address 127.6.37.62:45251)
0924 17:37:54.991989 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:54.991992 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:54.992223 (+ 231us) server_negotiation.cc:407] Connection header received
0924 17:37:54.992920 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:54.992921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:54.992933 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:54.992995 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:54.993724 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.994257 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.995402 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.995694 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.995776 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.998255 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:54.998256 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:54.998257 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:54.998264 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:54.999874 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.000308 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.000309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.000310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.000371 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.000648 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.000649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.000649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.000762 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.000815 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.001191 (+ 376us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.001284 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260924 17:37:55.001575 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.991821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.62:45251 (local address 127.0.0.1:45540)
0924 17:37:54.992073 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:54.992125 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:54.992813 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:54.993031 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:54.993035 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:54.993396 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:54.993627 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.993633 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.994340 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.994341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.995324 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:54.995327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.995809 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.995810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:54.995935 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.996461 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:54.996469 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:54.998162 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:54.999972 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:54.999981 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:54.999983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.000233 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.000455 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.000456 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.000457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.000586 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.000830 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:55.000837 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:55.001028 (+ 191us) client_negotiation.cc:769] Sending connection context
0924 17:37:55.001145 (+ 117us) client_negotiation.cc:240] Negotiation successful
0924 17:37:55.001305 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":48,"thread_start_us":95,"threads_started":1}
I20260924 17:37:55.001933 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:54.992751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40674 (local address 127.6.37.60:36919)
0924 17:37:54.992875 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:54.992880 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:54.992916 (+ 36us) server_negotiation.cc:407] Connection header received
0924 17:37:54.993019 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:54.993021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:54.993041 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:54.993118 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:54.993853 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.994931 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.995780 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:54.996215 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:54.996297 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:54.998754 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:54.998763 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:54.998763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:54.998770 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.000509 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.000884 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.000887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.000887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.000930 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.001131 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.001132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.001132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.001254 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.001428 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.001746 (+ 318us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.001828 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":72,"threads_started":1}
I20260924 17:37:55.002485 29468 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:37:55 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
Sep 24 17:37:55 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.62@KRBTEST.COM
I20260924 17:37:55.010032 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.002766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.61:32979 (local address 127.0.0.1:37730)
0924 17:37:55.002810 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:55.002820 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:55.002857 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:55.003026 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:55.003027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:55.003173 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:55.003204 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.003205 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.003954 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.003956 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.004508 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.004510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.004941 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.004942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.005004 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.005399 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:55.005403 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:55.006617 (+ 1214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:55.008906 (+ 2289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.008907 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.008907 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.009087 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.009311 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.009311 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.009312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.009368 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.009659 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:55.009660 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:55.009715 (+ 55us) client_negotiation.cc:769] Sending connection context
0924 17:37:55.009805 (+ 90us) client_negotiation.cc:240] Negotiation successful
0924 17:37:55.009916 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260924 17:37:55.010032 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.002848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37730 (local address 127.6.37.61:32979)
0924 17:37:55.002911 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.002913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.002921 (+ 8us) server_negotiation.cc:407] Connection header received
0924 17:37:55.002946 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.002947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.002959 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.003011 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.003286 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.003881 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.004586 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.004876 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.004927 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.006708 (+ 1781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.006709 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.006710 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.006717 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.008797 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.009176 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.009178 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.009178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.009235 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.009444 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.009445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.009446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.009583 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.009657 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.009832 (+ 175us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.009914 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260924 17:37:55.010617 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.002802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45546 (local address 127.6.37.62:45251)
0924 17:37:55.002840 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.002841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.002850 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:55.002962 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.002963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.002972 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.003028 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.003565 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.004059 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.004770 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.004992 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.005059 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.007289 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.007290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.007290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.007298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.008951 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.009344 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.009345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.009346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.009411 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.009631 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.009632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.009632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.009762 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.009951 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.009999 (+ 48us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.010552 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260924 17:37:55.010706 29468 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } has no permanent_uuid. Determining permanent_uuid...
Sep 24 17:37:55 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.60@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
Sep 24 17:37:55 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.6.37.61@KRBTEST.COM
I20260924 17:37:55.017985 29470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.011060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40690)
0924 17:37:55.011100 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:55.011109 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:55.011169 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:55.011310 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:55.011311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:55.011455 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:55.011489 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.011490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.012246 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.012247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.012747 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.012748 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.013144 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.013145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.013193 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.013660 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:55.013664 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:55.015092 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:55.016822 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.016823 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.016824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.017082 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.017283 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.017283 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.017284 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.017353 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.017648 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:55.017648 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:55.017701 (+ 53us) client_negotiation.cc:769] Sending connection context
0924 17:37:55.017750 (+ 49us) client_negotiation.cc:240] Negotiation successful
0924 17:37:55.017896 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260924 17:37:55.018371 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.011111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40690 (local address 127.6.37.60:36919)
0924 17:37:55.011171 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.011173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.011186 (+ 13us) server_negotiation.cc:407] Connection header received
0924 17:37:55.011233 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.011234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.011245 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.011300 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.011567 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.012168 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.012830 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.013062 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.013136 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.015176 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.015178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.015178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.015184 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.016756 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.017153 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.017155 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.017155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.017211 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.017435 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.017436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.017436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.017575 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.017655 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.017793 (+ 138us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.017975 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":95,"server-negotiator.queue_time_us":42}
I20260924 17:37:55.019349 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.011850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37734 (local address 127.6.37.61:32979)
0924 17:37:55.011900 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.011902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.011911 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:55.011932 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.011933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.011942 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.011986 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.012498 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.012988 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.013863 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.014114 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.014187 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.016409 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.016410 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.016410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.016417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.018256 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.018627 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.018628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.018628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.018688 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.018909 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.018910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.018910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.019026 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.019132 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.019236 (+ 104us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.019290 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260924 17:37:55.020133 29468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: Bootstrap starting.
I20260924 17:37:55.021106 6292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260924 17:37:55.021157 29468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:55.021467 29468 log.cc:824] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:55.022334 29468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: No bootstrap required, opened a new log
I20260924 17:37:55.021973 29289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c8b3a2d9fa344d0fbece96e9c1613495"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45546
I20260924 17:37:55.024454 29468 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.024614 29468 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84b9f2f65d444155882b6ed47f316bf6, State: Initialized, Role: FOLLOWER
I20260924 17:37:55.024690 29468 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.025012 29468 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:55.024972 29474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.025082 29474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:55.025337 29315 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } attempt: 2
W20260924 17:37:55.027199 29485 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:55.027251 29485 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:55.027297 29398 master_runner.cc:186] Error getting master registration for 127.6.37.62:45251: OK, instance_id { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" instance_seqno: 1790271474684673 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 17:37:55.029841 29398 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Sep 24 17:37:55 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.62@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:37:55.033138 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.025628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40696 (local address 127.6.37.60:36919)
0924 17:37:55.025667 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.025669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.025678 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:55.025760 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.025761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.025770 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.025812 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.026225 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.026964 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.027911 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.028278 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.028385 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.030458 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.030460 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.030460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.030466 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.031988 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.032352 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.032353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.032354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.032415 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.032615 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.032616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.032616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.032742 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.032814 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.032985 (+ 171us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.033051 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260924 17:37:55.033142 29317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.025591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40696)
0924 17:37:55.025630 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:55.025641 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:55.025685 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:55.025829 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:55.025831 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:55.026072 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:55.026127 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.026130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.027049 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.027050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.027817 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.027820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.028372 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.028373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.028440 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.028853 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:55.028858 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:55.030366 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:55.032090 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.032091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.032092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.032266 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.032487 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.032488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.032489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.032548 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.032819 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:55.032820 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:55.032865 (+ 45us) client_negotiation.cc:769] Sending connection context
0924 17:37:55.032949 (+ 84us) client_negotiation.cc:240] Negotiation successful
0924 17:37:55.033050 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260924 17:37:55.034636 29315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495: Bootstrap starting.
I20260924 17:37:55.035324 29315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:55.035619 29315 log.cc:824] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:55.036437 29315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495: No bootstrap required, opened a new log
I20260924 17:37:55.037773 29315 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.037915 29315 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8b3a2d9fa344d0fbece96e9c1613495, State: Initialized, Role: FOLLOWER
I20260924 17:37:55.038000 29315 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.038290 29315 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:55.038251 29488 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.038332 29289 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260924 17:37:55.038338 29488 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:55.038396 29289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:55.039265 29289 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.039664 29289 leader_election.cc:288] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [CANDIDATE]: Term 1 election: Requested vote from peers 2713838e061a43ad9a467646ecc71fd6 (127.6.37.61:32979), 84b9f2f65d444155882b6ed47f316bf6 (127.6.37.60:36919)
I20260924 17:37:55.040177 29441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "84b9f2f65d444155882b6ed47f316bf6"
I20260924 17:37:55.040287 29441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:55.041050 29441 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8b3a2d9fa344d0fbece96e9c1613495 in term 1.
I20260924 17:37:55.041522 29263 leader_election.cc:302] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84b9f2f65d444155882b6ed47f316bf6, c8b3a2d9fa344d0fbece96e9c1613495; no voters:
I20260924 17:37:55.043006 29488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 1 FOLLOWER]: Leader election won for term 1
I20260924 17:37:55.043179 29488 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [term 1 LEADER]: Becoming Leader. State: Replica: c8b3a2d9fa344d0fbece96e9c1613495, State: Running, Role: LEADER
I20260924 17:37:55.041162 29246 master_runner.cc:186] Error getting master registration for 127.6.37.61:32979: OK, instance_id { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" instance_seqno: 1790271474831509 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260924 17:37:55.043269 29488 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.043316 29246 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260924 17:37:55.043674 29505 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8b3a2d9fa344d0fbece96e9c1613495. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.043781 29505 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: This master's current role is: LEADER
W20260924 17:37:55.044106 29500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:55.044157 29500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:55.044513 29507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260924 17:37:55.044679 29507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260924 17:37:55.046391 29441 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [term 1 FOLLOWER]: Refusing update from remote peer c8b3a2d9fa344d0fbece96e9c1613495: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:55.046679 29505 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:55.047933 29474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8b3a2d9fa344d0fbece96e9c1613495. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.048024 29474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:55.053675 29318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.044400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45556 (local address 127.6.37.62:45251)
0924 17:37:55.044440 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.044442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.045876 (+ 1434us) server_negotiation.cc:407] Connection header received
0924 17:37:55.045975 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.045976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.045986 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.046016 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.047252 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.047772 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.048809 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.049061 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.049143 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.050680 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.050681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.050681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.050688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.052420 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.052833 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.052834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.052834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.052894 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.053117 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.053117 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.053118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.053228 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.053327 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.053468 (+ 141us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.053556 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260924 17:37:55.060108 29488 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.060227 29488 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:55.060225 29474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.060318 29474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:55.060518 29512 mvcc.cc:205] Tried to move back new op lower bound from 7332951961787531264 to 7332951961777897472. Current Snapshot: MvccSnapshot[applied={T|T < 7332951961787531264}]
I20260924 17:37:55.060747 29509 mvcc.cc:205] Tried to move back new op lower bound from 7332951961787531264 to 7332951961777897472. Current Snapshot: MvccSnapshot[applied={T|T < 7332951961787531264}]
I20260924 17:37:55.061488 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.045614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37746 (local address 127.6.37.61:32979)
0924 17:37:55.045657 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.045658 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.053718 (+ 8060us) server_negotiation.cc:407] Connection header received
0924 17:37:55.053826 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.053828 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.053838 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.053866 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.054572 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.055243 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.056339 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.056685 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.056747 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.058171 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.058173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.058173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.058180 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.059838 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.060394 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.060395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.060396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.060461 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.060745 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.060746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.060746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.060903 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.060999 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.061292 (+ 293us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.061390 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260924 17:37:55.062518 29507 catalog_manager.cc:1347] Generated new cluster ID: 904589071b3d4c38a5c7ab8b78a9602c
I20260924 17:37:55.062566 29507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260924 17:37:55.064652 29390 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } attempt: 3
I20260924 17:37:55.067988 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.051128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40710 (local address 127.6.37.60:36919)
0924 17:37:55.051167 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.051169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.059545 (+ 8376us) server_negotiation.cc:407] Connection header received
0924 17:37:55.060505 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.060506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.060516 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.060546 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.061247 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.061978 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.062988 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.063293 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.063338 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.065308 (+ 1970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.065309 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.065310 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.065316 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.066810 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.067215 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.067216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.067216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.067262 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.067485 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.067486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.067486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.067601 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.067672 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.067838 (+ 166us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.067904 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Sep 24 17:37:55 dist-test-slave-gcz9 krb5kdc[29233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790271474, etypes {rep=17 tkt=17 ses=17}, kudu/127.6.37.61@KRBTEST.COM for kudu/127.6.37.60@KRBTEST.COM
I20260924 17:37:55.075477 29392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.064906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.37.60:36919 (local address 127.0.0.1:40722)
0924 17:37:55.064983 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0924 17:37:55.064992 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0924 17:37:55.065025 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0924 17:37:55.068455 (+ 3430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0924 17:37:55.068456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0924 17:37:55.068601 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0924 17:37:55.068640 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.068642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.069450 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.069451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.070250 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0924 17:37:55.070252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.070709 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.070710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0924 17:37:55.070757 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.071167 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0924 17:37:55.071171 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0924 17:37:55.072645 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0924 17:37:55.074423 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.074424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.074424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.074624 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.074800 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0924 17:37:55.074800 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0924 17:37:55.074801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0924 17:37:55.074850 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0924 17:37:55.075168 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0924 17:37:55.075169 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0924 17:37:55.075210 (+ 41us) client_negotiation.cc:769] Sending connection context
0924 17:37:55.075272 (+ 62us) client_negotiation.cc:240] Negotiation successful
0924 17:37:55.075367 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260924 17:37:55.076040 29472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:55.065094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40722 (local address 127.6.37.60:36919)
0924 17:37:55.068052 (+ 2958us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.068054 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.068061 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:37:55.068076 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.068076 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.068084 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.068127 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.068712 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.069365 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.070342 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:55.070620 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:55.070667 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:55.072753 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0924 17:37:55.072754 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0924 17:37:55.072754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0924 17:37:55.072760 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0924 17:37:55.074324 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.074692 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.074693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.074693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.074740 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0924 17:37:55.074959 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0924 17:37:55.074959 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0924 17:37:55.074960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0924 17:37:55.075088 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0924 17:37:55.075141 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:55.075865 (+ 724us) server_negotiation.cc:299] Negotiation successful
0924 17:37:55.075945 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2945,"thread_start_us":69,"threads_started":1}
I20260924 17:37:55.077776 29390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: Bootstrap starting.
I20260924 17:37:55.078507 29390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: Neither blocks nor log segments found. Creating new log.
I20260924 17:37:55.078789 29390 log.cc:824] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: Log is configured to *not* fsync() on all Append() calls
I20260924 17:37:55.082098 29390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: No bootstrap required, opened a new log
I20260924 17:37:55.084324 29390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.084471 29390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2713838e061a43ad9a467646ecc71fd6, State: Initialized, Role: FOLLOWER
I20260924 17:37:55.084564 29390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } }
I20260924 17:37:55.084949 29390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260924 17:37:55.085045 29363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260924 17:37:55.086066 29363 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [term 1 FOLLOWER]: Refusing update from remote peer c8b3a2d9fa344d0fbece96e9c1613495: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260924 17:37:55.086329 29507 catalog_manager.cc:1370] Generated new certificate authority record
I20260924 17:37:55.086427 29488 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260924 17:37:55.086272 29364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2713838e061a43ad9a467646ecc71fd6"
I20260924 17:37:55.084887 29519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.087687 29519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:55.087893 29507 catalog_manager.cc:1504] Loading token signing keys...
I20260924 17:37:55.088057 29364 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8b3a2d9fa344d0fbece96e9c1613495 in term 1.
I20260924 17:37:55.091110 29519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8b3a2d9fa344d0fbece96e9c1613495. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.091230 29519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: This master's current role is: FOLLOWER
I20260924 17:37:55.091310 29519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.091429 29519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6 [sys.catalog]: This master's current role is: FOLLOWER
W20260924 17:37:55.091519 29530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260924 17:37:55.091560 29530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260924 17:37:55.100118 29531 mvcc.cc:205] Tried to move back new op lower bound from 7332951961933783040 to 7332951961777897472. Current Snapshot: MvccSnapshot[applied={T|T < 7332951961787531264}]
I20260924 17:37:55.109040 29505 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8b3a2d9fa344d0fbece96e9c1613495" member_type: VOTER last_known_addr { host: "127.6.37.62" port: 45251 } } peers { permanent_uuid: "2713838e061a43ad9a467646ecc71fd6" member_type: VOTER last_known_addr { host: "127.6.37.61" port: 32979 } } peers { permanent_uuid: "84b9f2f65d444155882b6ed47f316bf6" member_type: VOTER last_known_addr { host: "127.6.37.60" port: 36919 } } }
I20260924 17:37:55.109175 29505 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495 [sys.catalog]: This master's current role is: LEADER
I20260924 17:37:55.110929 29507 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8b3a2d9fa344d0fbece96e9c1613495: Generated new TSK 0
I20260924 17:37:55.111167 29507 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260924 17:37:55.140239 29517 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.138383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40738 (local address 127.6.37.60:36919)
0924 17:37:55.138441 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.138444 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.139461 (+ 1017us) server_negotiation.cc:407] Connection header received
0924 17:37:55.139581 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.139582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.139596 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.139641 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.140140 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40738: BlockingRecv error: recv got EOF from 127.0.0.1:40738 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260924 17:37:55.141165 29318 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.138662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45568 (local address 127.6.37.62:45251)
0924 17:37:55.138701 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.138703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.140624 (+ 1921us) server_negotiation.cc:407] Connection header received
0924 17:37:55.140722 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.140724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.140734 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.140763 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.141103 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45568: BlockingRecv error: recv got EOF from 127.0.0.1:45568 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260924 17:37:55.142092 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.139168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.6.37.61:32979)
0924 17:37:55.139209 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.139211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.141535 (+ 2324us) server_negotiation.cc:407] Connection header received
0924 17:37:55.141688 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.141689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.141700 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.141730 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.142030 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37762: BlockingRecv error: recv got EOF from 127.0.0.1:37762 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260924 17:37:55.144435 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.143688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37766 (local address 127.6.37.61:32979)
0924 17:37:55.143721 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.143722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.143906 (+ 184us) server_negotiation.cc:407] Connection header received
0924 17:37:55.144011 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.144012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.144029 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.144058 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.144389 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37766: BlockingRecv error: recv got EOF from 127.0.0.1:37766 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260924 17:37:55.147559 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.146714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37776 (local address 127.6.37.61:32979)
0924 17:37:55.146746 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.146747 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.147032 (+ 285us) server_negotiation.cc:407] Connection header received
0924 17:37:55.147127 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.147128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.147137 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.147166 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.147503 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37776: BlockingRecv error: recv got EOF from 127.0.0.1:37776 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260924 17:37:55.151412 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.150656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37790 (local address 127.6.37.61:32979)
0924 17:37:55.150697 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.150698 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.150918 (+ 220us) server_negotiation.cc:407] Connection header received
0924 17:37:55.151014 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.151015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.151024 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.151052 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.151371 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37790: BlockingRecv error: recv got EOF from 127.0.0.1:37790 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260924 17:37:55.157263 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.156536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37798 (local address 127.6.37.61:32979)
0924 17:37:55.156569 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.156571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.156790 (+ 219us) server_negotiation.cc:407] Connection header received
0924 17:37:55.156883 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.156884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.156894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.156923 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.157221 (+ 298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37798: BlockingRecv error: recv got EOF from 127.0.0.1:37798 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260924 17:37:55.167456 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.166514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37804 (local address 127.6.37.61:32979)
0924 17:37:55.166565 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.166567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.166822 (+ 255us) server_negotiation.cc:407] Connection header received
0924 17:37:55.166963 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.166964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.166976 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.167008 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.167387 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37804: BlockingRecv error: recv got EOF from 127.0.0.1:37804 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260924 17:37:55.186057 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.184965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.6.37.61:32979)
0924 17:37:55.185008 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.185010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.185392 (+ 382us) server_negotiation.cc:407] Connection header received
0924 17:37:55.185505 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.185507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.185519 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.185551 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.185997 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37810: BlockingRecv error: recv got EOF from 127.0.0.1:37810 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260924 17:37:55.220667 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.219642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37818 (local address 127.6.37.61:32979)
0924 17:37:55.219691 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.219694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.220015 (+ 321us) server_negotiation.cc:407] Connection header received
0924 17:37:55.220132 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.220133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.220145 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.220177 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.220607 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37818: BlockingRecv error: recv got EOF from 127.0.0.1:37818 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260924 17:37:55.287065 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.286271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37832 (local address 127.6.37.61:32979)
0924 17:37:55.286353 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.286356 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.286453 (+ 97us) server_negotiation.cc:407] Connection header received
0924 17:37:55.286550 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.286551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.286565 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.286621 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.286992 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37832: BlockingRecv error: recv got EOF from 127.0.0.1:37832 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260924 17:37:55.417107 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.416281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37838 (local address 127.6.37.61:32979)
0924 17:37:55.416358 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.416361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.416456 (+ 95us) server_negotiation.cc:407] Connection header received
0924 17:37:55.416555 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.416556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.416574 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.416618 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.416990 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37838: BlockingRecv error: recv got EOF from 127.0.0.1:37838 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260924 17:37:55.674921 29395 negotiation.cc:337] Failed RPC negotiation. Trace:
0924 17:37:55.674190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37842 (local address 127.6.37.61:32979)
0924 17:37:55.674266 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:55.674268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:55.674281 (+ 13us) server_negotiation.cc:407] Connection header received
0924 17:37:55.674382 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:55.674383 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:55.674396 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:55.674458 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0924 17:37:55.674818 (+ 360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37842: BlockingRecv error: recv got EOF from 127.0.0.1:37842 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260924 17:37:56.027700 29485 catalog_manager.cc:1259] Loaded cluster ID: 904589071b3d4c38a5c7ab8b78a9602c
I20260924 17:37:56.027777 29485 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: loading cluster ID for follower catalog manager: success
I20260924 17:37:56.028620 29485 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: acquiring CA information for follower catalog manager: success
I20260924 17:37:56.028889 29485 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 84b9f2f65d444155882b6ed47f316bf6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 17:37:56.092005 29530 catalog_manager.cc:1259] Loaded cluster ID: 904589071b3d4c38a5c7ab8b78a9602c
I20260924 17:37:56.092084 29530 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: loading cluster ID for follower catalog manager: success
I20260924 17:37:56.092916 29530 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: acquiring CA information for follower catalog manager: success
I20260924 17:37:56.093189 29530 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2713838e061a43ad9a467646ecc71fd6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260924 17:37:56.190361 29607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:56.187924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37856 (local address 127.6.37.61:32979)
0924 17:37:56.188064 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:56.188066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:56.188103 (+ 37us) server_negotiation.cc:407] Connection header received
0924 17:37:56.188169 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:56.188170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:56.188223 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:56.188305 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:56.188440 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.188943 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.189683 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.189876 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.189926 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:56.190067 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:56.190179 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:56.190238 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:56.190273 (+ 35us) server_negotiation.cc:299] Negotiation successful
0924 17:37:56.190292 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":89,"threads_started":1}
I20260924 17:37:56.194537 29613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:56.192274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.6.37.60:36919)
0924 17:37:56.192397 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:56.192400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:56.192407 (+ 7us) server_negotiation.cc:407] Connection header received
0924 17:37:56.192444 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:56.192444 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:56.192477 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:56.192550 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:56.192634 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.193095 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.193826 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.194030 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.194100 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:56.194257 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:56.194359 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:56.194424 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:56.194456 (+ 32us) server_negotiation.cc:299] Negotiation successful
0924 17:37:56.194476 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":76,"threads_started":1}
I20260924 17:37:56.199573 29613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:56.196636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.6.37.60:36919)
0924 17:37:56.196700 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:56.196702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:56.196711 (+ 9us) server_negotiation.cc:407] Connection header received
0924 17:37:56.196917 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:56.196918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:56.196928 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:56.196991 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:56.197155 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.197630 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.198661 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.199009 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.199054 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:56.199293 (+ 239us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:56.199325 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:56.199380 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:56.199476 (+ 96us) server_negotiation.cc:299] Negotiation successful
0924 17:37:56.199506 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260924 17:37:56.199644 29619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:56.196405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45576 (local address 127.6.37.62:45251)
0924 17:37:56.196533 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:56.196535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:56.196644 (+ 109us) server_negotiation.cc:407] Connection header received
0924 17:37:56.196765 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:56.196766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:56.196845 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:56.196920 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:56.197099 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.197867 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.198646 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.198924 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.198995 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:56.199186 (+ 191us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:56.199296 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:56.199358 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:56.199530 (+ 172us) server_negotiation.cc:299] Negotiation successful
0924 17:37:56.199552 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260924 17:37:56.199965 29607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0924 17:37:56.196526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37866 (local address 127.6.37.61:32979)
0924 17:37:56.196576 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0924 17:37:56.196578 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0924 17:37:56.196719 (+ 141us) server_negotiation.cc:407] Connection header received
0924 17:37:56.196825 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0924 17:37:56.196826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0924 17:37:56.196838 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0924 17:37:56.196897 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0924 17:37:56.197149 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.197849 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.198895 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0924 17:37:56.199187 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0924 17:37:56.199245 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0924 17:37:56.199423 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0924 17:37:56.199456 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0924 17:37:56.199501 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0924 17:37:56.199860 (+ 359us) server_negotiation.cc:299] Negotiation successful
0924 17:37:56.199885 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260924 17:37:56.208388 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 29246
I20260924 17:37:56.213863 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 29322
I20260924 17:37:56.219008 6292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskzK0f6g/build/release/bin/kudu with pid 29398
2026-09-24T17:37:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2812 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5673 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (302403 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS